AD-A242  958 


NAVAL  POSTGRADUATE  SCHOOL 


Monterey,  California 


THESIS 


PARTICIPATION  AND  ERROR  RATES  OF  THE  INTERNAL 
REVENUE  SERVICE  ELECTRONIC  FILING  SYSTEM: 
EMPIRICAL  EVIDENCE  AND  IMPLEMENTATION  LESSONS 

by 

Carol  P.  Elliott 
March  1991 

Thesis  Advisor:  Tung  X.  Bui 


Approved  for  public  release;  distribution  is  unlimited 


91-16787 


Unclassified 


SECURITY  classification  OF  THIS  PAGE 


REPORT  DOCUMENTATION  PAGE 


la.  REPORT  SECURITY  CLASSIFICATION 
UNCLASSIFIED 


2a.  SECURITY  CLASSIFICATION  AUTHORITY 


2b.  0ECLASSIFICATI0NR30WNGRADING  SCHEDULE 


1b.  RESTRiaiVE  MARKINGS 


3.  DISTRIBUTION/AVAILABILITY  OF  REPORT 
Approved  for  public  release;  distribution  is  unlimited. 


4.  PERFORMING  ORGANIZATION  REPORT  NUMBER(S) 


S.  MONITORING  ORGANIZATION  REPORT  NUMBER(S) 


6a.  NAME  OF  PERFORMING  ORGANIZATION 
Naval  Postgraduate  School 


6c.  ADDRESS  (City.  State,  and  ZIP  Code) 
Monterey,  CA  93943-6000 


6b  OFFICE  SYMBOL 
(If  applicable) 

37 


7a.  NAME  OF  MONITORING  ORGANIZATION 
Naval  Postgraduate  School 


7b.  ADDRESS  (City.  State,  and  ZIP  Code) 
Monterey,  CA  93943-5000 


8a.  NAME  OF  FUNDING/SPONSORING 
ORGANIZATION 


8b.  OFFICE  SYMBOL 
(If  applicable) 


9.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 


8c.  ADDRESS  (City,  State,  and  ZIP  Code) 


10.  SOURCE  OF  FUNDING  NUMBERS 


Program  Element  No. 


Work  unit  Accetsion 


1 1 .  TITLE  (Include  Security  Classification) 

PARTICIPATION  AND  ERROR  RATES  OF  THE  INTERNAL  REVENUE  SERVICE  ELECTRONIC  FlUNG  SYSTEM:  EMPIRICAL 
EVIDENCE  AND  IMPLEMENTATION  LESSONS 


1 2  PE  RSON AL  AUTHOR(S)  Elliott,  Carol  P. 


13b  TIME  COVERED 
From  To 


13a  TYPE  OF  REPORT  13b  TIME  COVERED  14.  DATE  OF  REPORT  (year,  month,  day)  IS.  PAGE  COUNT 

Master's  Thesis  From  To  March  1991  87 


16.  SUPPLEMENTARY  NOTATION 

The  views  expressed  in  this  thesis  are  those  of  the  author  and  do  not  reflect  the  official  policy  or  position  of  the  Department  of  Defense  or  the  U.S. 
Government. 


17.  COSATI  CODES  _ 1 1  g.  SUBJECT  TERMS  (continue  on  reverse  if  necessary  and  identify  by  block  number) 

field  i  GROUP  I  SUBGROUP  I  End-User  Computing,  Electronic  Filing  System,  Information  Systems,  Implementation  of 

Information  Systems 


19.  ABSTRACT  (continue  on  reverse  if  necessary  and  identify  by  block  number) 

The  process  of  collecting  revenue  has  become  increasingly  costly  for  the  Internal  Revenue  Service  (ISR)  in  terms  of  requirements  for  storage  space 
and  complexity  and  time  involved  in  converting  paper  returns  into  machine  readable  form.  To  alleviate  these  problems,  the  IRS  proposed  and 
developed  the  Electronic  Filing  System  (EFS)  which  provides  taxpayers  the  option  of  filing  tax  returns  electronically.  This  study  consists  of  a  two 
year  field  study  of  the  EFS  in  the  IRS  San  Jose  District  with  respect  to  the  reasons  for  success  or  failure  of  the  implementation  of  computer 
systems,  with  particular  emphasis  on  the  participation  rate  and  the  error  rate.  The  study  includes  a  statistical  analysis  of  responses  to  two 
surveys  distributed  by  the  San  Jose  District  EFS  Office  to  determine  whether  there  is  significant  evidence  to  indicate  reasons  why  some  users 
have  higher  error  rates  than  others.  A  case  study  approach  is  used,  in  conjunction  with  available  literature,  to  determine  factors  which  influence 
the  effective  implementation  of  an  information  system  and  encourage  use  of  the  system. 


20  DISTRIBUTION/AVAILABILITY  OF  ABSTRACT 


UNCLASSIFIEO/UNLIMITED 


SAME  AS  REPORT 


22a  NAME  OF  RESPONSIBLE  INDIVIDUAL 
Tung  X.  Bui 


DD  FORM  1473. 84  MAR 


21 .  ABSTRAa  SECURITY  CLASSIFICATION 
Unclassified 


22b  TELEPHONE  (Include  Area  code) 
1408)646  2630 


83  APR  edition  may  be  used  until  exhsusted  SECURITY  C 


22c  OFFICE  SYMBOL 
AS-BD 


All  other  editions  are  obsolete 


Unclassified 


1 


Approved  for  public  release;  distribution  is  unlimited. 

Participation  and  Error  Rates  of  the 
Internal  Revenue  Service  Electronic  Filing  System: 
Empirical  Evidence  and  Implementation  Lessons 

by 

Carol  P.  Elliott 

Lieutenant,  United  States  Navy 
B.A.,  Goucher  College,  1971 

Submitted  in  partial  fulfillment 
of  the  requirements  for  the  degree  of 

MASTER  OF  SCIENCE  IN  INFORMATION  SYSTEMS 

from  the 


NAVAL  POSTGRADUATE  SCHOOL 

March  1991 
% 

Author:  _ _ 

Carol  P.  Elliott 


Approved  by: 


/  X 


Tung  X.  Bui,  Thesis  Advisor 


es  R.  Kinsey,  Second  Real 


David  R.  Whipple,  Chairman 
Department  of  Administrative  Sciences 


11 


ABSTRACT 


The  process  of  collecting  revenue  has  become  increasingly  costly  for  the 
Internal  Revenue  Service  (IRS)  in  terms  of  requirements  for  storage  space  and  the 
complexity  and  time  involved  in  converting  paper  returns  into  machine  readable 
form.  To  alleviate  these  problems,  the  IRS  proposed  and  developed  the  Electronic 
Filing  System  (EFS)  which  provides  taxpayers  the  option  of  filling  tax  returns 
electronically.  This  study  consists  of  a  two  year  field  study  of  the  EFS  in  the  San 
Jose  District  with  respect  to  the  reasons  for  success  or  failure  of  the 
implementation  of  computer  systems,  with  particular  emphasis  on  the 
participation  rate  and  the  error  rate.  The  study  includes  a  statistical  analysis  of 
responses  to  two  surveys  distributed  by  the  San  Jose  District  EFS  Office  to 
determine  whether  there  is  significant  evidence  to  indicate  reasons  why  some  users 
have  higher  error  rates  than  others.  A  case  study  approach  is  used,  in  conjunction 
with  available  literature,  to  determine  factors  which  influence  the  effective 
implementation  of  an  information  system  and  encourage  use  of  the  system. 
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I.  INTRODUCTION 


A.  BACKGROUND 

The  process  of  collecting  revenue  has  become  increasingly  costly  for  the  Internal 
Revenue  Service  (IRS).  The  increasing  number  of  returns  processed  each  year  has 
resulted  in  continually  increasing  need  for  storage  space.  In  addition,  the  process  of 
converting  paper  returns  into  machine  readable  form  has  become  more  complex,  time- 
consuming  and  error-prone.  [Ref.  1] 

To  alleviate  these  problems,  the  IRS  proposed  and  developed  a  system  for  the 
electronic  filing  of  tax  returns.  The  IRS  electronic  filing  pilot  program  was  initiated  in 
1986.  The  program  has  expanded  each  year  since  and  is  currently  available  in  all  SO 
states. 


B.  OBJECTIVES  AND  RESEARCH  QUESTIONS 

The  San  Jose  District  Electronic  Filing  Coordinator  has  expressed  interest  in 
increasing  the  participation  rate  for  the  area  served  by  his  office  and  reducing  the  current 
error  rate.  The  San  Jose  District  of  the  IRS  has  participated  in  the  Electronic  Filing 
System  (EFS)  since  1988.  This  study  considers  possible  explanations  for  die  existing  rates 
and  explores  potential  methods  and  approaches  to  increase  the  partic^ation  rate  and  lower 
the  error  rate. 
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SpecMcally,  the  questions  addressed  are: 

1.  Why  do  some  filers  have  very  low  eiror  rates  while  others  have  high  error  rates? 

2.  How  can  the  participation  rate  be  increased? 

3.  How  can  the  error  rate  be  reduced? 

4.  What  are  the  lessons  learned  to  successfully  implement  a  large  scale  con^ter 
application? 

C.  SCOPE 

The  study  consists  of  a  two  year  field  study  of  the  EPS  in  the  San  Jose  District  with 
respect  to  the  reasons  for  success  or  failure  of  the  implementation  of  computer  systems. 
Particular  areas  of  emphasis  are  the  participation  rate  and  the  error  rate. 
Reconunendations  on  increasing  the  participation  rate  and  lowering  the  error  rate  are 
proposed. 

D.  METHODOLOGY 

The  San  Jose  District  EPS  Office  distributed  surveys  to  all  tax  practitioners  accepted 
into  the  EPS  program  following  the  1989  and  1990  filing  seasons.  The  study  statistically 
analyzes  responses  to  the  two  surveys  to  determine  whet  '  there  is  significant  evidence 
to  indicate  reasons  why  some  users  have  higher  error  rates  than  others. 

Consideration  of  the  participation  rate  includes  an  examination  of  the  comments 
provided  by  tax  practitioners  on  the  surveys.  A  case  study  iq>proach  is  used,  in 
conjunction  with  available  literature,  to  determine  factors  which  influence  the  effective 
implementation  of  an  information  system  and  encourage  use  of  the  system. 


E.  ORGANIZATION  OF  STUDY 


This  study  is  discussed  in  detail  in  the  following  pages.  Cht^ter  II  provides  a 
review  of  the  {q>plicable  literature.  Chapter  III  includes  a  history  of  EFS  and  a  discussion 
of  the  EFS  concept  and  components.  Chapter  IV  provides  a  definition  of  the  problem  to 
be  examined,  describes  the  survey  data  and  summarizes  the  statistical  analysis 
methodology  and  results  with  regard  to  the  error  rate  for  filers.  The  implementation  of 
EFS  as  a  case  study  of  implementation  of  end-user  computing  systems  is  discussed  in 
Chapter  V.  Chapter  VI  includes  a  discussion  of  the  findings  of  the  study  and 
recommendations  for  lowering  the  error  rate  and  increasing  the  participation  rate. 
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n.  LITERATURE  REVIEW 


A.  OVERVIEW  OF  LITERATURE 

The  literature  reviewed  for  this  study  falls  into  three  general  categories:  (1) 
implementation  of  computing  systems,  (2)  end-user  computing,  and  (3)  the  use  of  case 
studies  in  MIS  research.  Some  of  the  literature  overlaps  categories  (1)  and  (2)  because 
it  directly  addresses  in^lementation  of  end-user  computing  systems. 

While  there  is  an  abundance  of  literature  on  implementation  of  information  systems 
in  organizations,  its  £^licability  to  this  study  is  not  definitive  because  of  the  unique 
environment  in  which  EFS  operates.  It  is  a  system  with  users  in  many  different 
organizations;  its  structure  does  not  conform  to  any  other  organizational  structure.  The 
^application  of  literature  in  the  first  category  is  used,  therefore,  with  the  understanding  that 
it  does  not  directly  reflect  the  EFS  environment.  Literature  in  the  second  category,  end- 
user  computing,  offers  different  definitions/categorizations  of  end-users.  It  examines 
success  factors  in  end-user  computing  which  are  useful  in  discerning  factors  which 
influence  successful  acceptance  of  and  participation  in  EFS.  The  third  category,  the  use 
of  case  studies  in  MIS  research,  provides  support  for  use  of  a  case  study,  such  as  that 
employed  in  this  study,  to  perform  MIS  research. 


4 


B.  IMPLEMENTATION  LITERATURE 


1.  Lewin-Schein  and  Kolb-Frohman  Models 

Implementation  of  a  management  infonnation  system  involves  changes  in  the 
organization  in  which  the  system  is  implemented,  just  as  the  introduction  of  any  new 
technology  or  practice  results  in  change.  Numerous  models  of  change  have  been 
proposed;  among  them  are  the  Lewin-Schein  theory  of  change  and  the  Kolb-Frohman 
model  [Ref.  2:p.  65]. 

The  Lewin-Schein  model  divides  the  change  process  into  three  sequential 
stages— unfreezing,  moving  and  refreezing.  The  unfreezing  stage  includes  "...activities  that 
help  members  of  an  organization  to  free  themselves  from  the  patterns  of  behavior  and 
mind-sets  in  existence  prior  to  the  introduction  of  change."  [Ref.  2:p.  65]  In  the  moving 
stage,  organization  members  learn  new  behavior.  The  final  stage,  refiteezing,  makes  the 
new  behavior  patterns  permanent. 

The  Kolb-Frohman  model  operationalized  the  Lewin-Schein  model,  mapping 
seven  stages  onto  its  three.  In  the  Kolb-Frohman  model,  the  scouting,  entry  and  diagnosis 
stages  correspond  to  Lewin-Schein’s  unfreezing  stage.  The  moving  stage  is  divided  into 
two— plaiuiing  and  action— in  the  Kolb-Frohman  model,  while  the  evaluation  stage  overljq>s 
the  moving  and  refreezing  stages.  Kolb-Frohman’s  final  stage,  termination,  corresponds 
to  the  refreezing  stage. 
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2.  Factors  Affecting  Implementation 

The  process  of  implementation  is  a  complex  one  which  must  consider  the 
organizational,  behavioral  and  environmental  as  well  as  the  technological  facets  involved 
in  the  design,  development  and  operation  of  information  systems  within  organizations 
[Refs.  3,  4,  5,  6].  According  to  Ginzberg  and  Schultz,  implementation  is  dynamic  in 
nature  as  evidenced  by  the  constant  changes  in  the  implementation  environment, 
technology,  and  approaches  to  implementation  [Ref.  3:p.  2].  Rivard  en^hasizes  the 
importance  of  planning  to  implementation,  asserting  that  successful  implementation 
requires  careful  planning  in  the  determination  of  users’  requirements  and  the  development 
of  criteria,  methods  and  procedures  for  evaluation  [Ref.  4:p.  33].  In  discussing  the 
reasons  information  systems  fail,  Lucas  lists  three  problem  areas  in  system  design  and 
implementation:  technical,  organizational  and  project  management  [Ref.  6:p.  4].  He 
states  that,  "Concentration  on  the  technical  aspects  of  systems  and  a  tendency  to  overtook 
organizational  behavior  problems  and  users  are  the  reasons  most  information  systems  have 
failed."  [Ref.  6:p.  2] 

The  significance  of  organizational  behavior  to  the  success  or  failure  of 
implementation  of  information  systems  recurs  often  in  the  literature  [Refs.  6,  7,  8,  9]. 
According  to  Lucas,  "...the  major  reason  most  information  systems  have  failed  is  diat  we 
have  ignored  organizational  behavior  problems  in  the  design  and  operation  of  computer 
based  information  systems."  [Ref.  6:p.  6]  He  states  that  organizational  behavior  variables 
must  be  considered  if  systems  are  going  to  be  designed  and  operated  successfully  [Ref. 
6:p.  106].  Desanctis  and  Courmey  also  emphasize  the  significant  role  of  organizational 
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behavior  in  implementation  and  propose  merging  organizational  development  techniques 
into  MIS  implementation  [Ref.  8:p.  733]. 

3.  User  Participation  and  Attitude 

User  participation  in  system  development  and  operation  and  users'  attitudes 
toward  the  system  are  other  areas  of  importance  discussed  in  the  literature  [Refs.  6,  8, 
10].  Baroudi,  Olson,  and  Ives’  study  demonstrates  that  user  involvement  in  the 
development  of  an  information  system  positively  correlates  with  system  usage  [Ref.  10;p. 
236].  Lucas  states  that  user  participation  in  design  considerations  is  essential.  The  user 
should  be  the  source  of  the  systems  and  design  them  wherever  possible,  delineating 
decisions  and  user  actions  as  well  as  flow  of  information  and  documents.  [Ref.  6:p.  Ill] 
Lucas  asserts  that  user  involvement  in  design  and  operation  results  in  favorable  user 
attitudes  and  perceptions  which  lead  to  high  levels  of  use.  [Ref.  6:pp.  22-23]  Desanctis 
and  Courtney  also  stress  the  importance  of  user  attitude.  They  state  that, 
"...implementation  research  suggests  that  it  is  not  enough  that  the  technology  be  friendly 
to  the  user.  The  user  must  also  be  friendly  to  the  system."  [Ref.  8:p.  732] 

4.  Implementation  Process 

The  process  used  to  implement  an  information  system  has  a  significant  effect 

on  the  system’s  success  or  failure  [Refs.  2,  11,  12].  Srinivasan  and  Davis  state  that. 

The  advent  of  powerful  new  technologies  coupled  with  an  array  of  diverse  user 
types  has  resulted  in  system  usage  patterns  that  the  process  models  are  unable  to 
capture.  An  alternative  perspective  focuses  on  the  user  and  user  roles,  the 
mechanisms  that  exist  for  the  facilitation  and  support  of  users,  and  the  nature  of 
learning  that  has  occurred  in  the  system  environments  of  organizations.  [Ref.  2:p. 
64] 


According  to  Srinivasan  and  Davis,  process  models  such  as  the  Lewin-Schein  and  the 
Kolb-Frohman  models  are  based  on  assumptions  which  may  no  longer  be  valid.  These 
models  assume  that  implementors  act  as  change  agents  and  that  user  groups  are 
homogeneous  and  somewhat  resistant  to  change.  In  contrast,  Srinivasan  and  Davis 
suggest  that  implementors  are  now  facilitators  and  coaches  to  a  heterogenous  group  of 
users,  a  good  proportion  of  which  are  not  resistant  to  the  introduction  of  information 
systems.  [Ref.  8;p.  67] 

Receptiveness  to  innovations  is  an  important  consideration  when  developing 
a  process  for  implementation.  Leonard-Barton,  in  discussing  the  subject  of  resistance  to 
and  acceptance  of  innovation,  states  that  innovations  rarely  meet  with  immediate 
acceptance.  In  a  study  of  the  introduction  of  structured  software  methodologies,  Leonard- 
Barton  emphasized  that  implementation  managers  must  build  positive  influences  and 
counter  negative  ones  to  facilitate  acceptance  of  innovations  within  an  organization.  [Ref. 

12:p.  6] 

C.  END-USER  COMPUTING  LITERATURE 

The  literature  reviewed  on  the  subject  of  end-use.  '  mputing  can  be  divided  into 
two  subcategories:  (1)  definition/classification  of  end-users  and  (2)  successful 
implementation  of  and  user  satisfaction  with  end-user  computing  systems.  Applicability 
of  literature  in  the  second  category  is  influenced  by  the  authors’  conceptualizations  of  the 
end-user.  The  data  and  insights  provided  by  the  authors  are,  therefore,  not  applicable  to 
all  end  users.  [Ref.  13:p.  1313] 
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1.  Definitions  of  End-Users 


E>efinitions  of  end-users  vary  from  general  to  very  specific.  The  more  specific 
ones,  such  as  the  definitions  of  Rockart  and  Flannery  [Ref.  14]  and  Cotterman  and  Kumar 
[Ref.  13],  recognize  that  degree  of  involvement  with  a  system  throughout  its  life  cycle, 
as  well  as  interaction  with  the  operational  system,  is  important  to  a  meaningful 
definition/classification  of  an  end-user. 

Doll  and  Torkzadeh’s  and  Davis  and  Olson’s  definitions  are  among  the  more 
general  ones  [Ref.  15].  Doll  and  Torkzadeh  define  end-users  as  "...individuals  who 
interact  directly  with  the  computer."  [Ref.  15;p.  261]  Davis  and  Olson  distinguish 
between  primary  and  secondary  users.  Primary  users  make  decisions  based  on  the 
system’s  output  while  secondary  users  interact  with  the  triplication  to  enter  information 
or  prepare  reports.  Secondary  users  do  not  use  system  output  directly.  [Ref.  15:p.  261] 
The  CODASYL  end-user  facilities  committee  identifies  three  classes  of  end- 
users.  Indirect  end-users  use  computers  through  other  people.  Intermediate  end-users 
specify  information  requirements  for  reports  which  they  receive.  Direct  end-users  use  the 
computer  terminals.  [Refs.  13,  15]  Rockart  and  Flannery  further  refine  the  CODASYL 
classification  into  six  classes  of  end-users  [Ref.  14]. 

Cotterman  and  Kumar  examine  numerous  definitions/classifications  of  end- 
users  with  the  objective  of  developing  "...a  precise  and  comprehensive  definition  and 
taxonomy  of  end  users."  [Ref.  13:p.  1313]  They  define  end-user  and  end-user  confuting 
as  follows: 
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An  end  user  is  any  organizational  unit  or  person  who  has  an  interaction  with  the 
computer-based  information  system  as  a  consumer  or  producer/consumer  of 
information.  End  user  computing  is  the  producer  activities  of  the  end  users  relative 
to  the  organization’s  computer-based  information  system.  [Ref.  13:p.  1315] 

Cotteiman  and  Kumar  identify  three  dimensions  in  the  classification  of  end-users: 

operation,  development,  and  control.  The  operation  dimension  involves  actual  hands-on 

operation  of  the  system  hardware  and  software.  The  development  dimension  includes  the 

performance  of  tasks  related  to  system  development.  The  control  dimension  consists  of 

the  "...decision-making  authority  to  acquire,  deploy,  and  use  the  resources  needed  to 

develop  and  operate  [the  system]."  [Ref.  13:p.  1315]  These  three  dimensions  can  be 

superimposed  on  a  cube  (Figure  1)  which  can  be  used  to  classify  end-users  according  to 

the  degree  of  their  involvement  with  each  of  the  dimensions.  Applying  the  CODASYL 

classifications  to  the  user  cube,  for  example,  would  result  in  locating  the  indirect  user  at 

(0,0,0);  the  intermediate  user  between  (0,0,0)  and  (0,1,0),  depending  on  extent  of 

involvement  with  development  effort;  and  the  direct  user  between  (0,0,0)  and  (1,0,0). 

[Ref.  13:pp.  1315-1316] 

2.  Implementation  Success  Factors  and  User  Satisfaction  in  End-User 
Computing  Systems 

Success  factors  offered  in  the  literature  are  numerous  and  varied.  Rockart  and 
Flannery  cite  the  need  for  brief,  example-based  education  for  end-users  who  desire  to 
learn  only  as  much  as  they  need  to  know  to  perform  the  tasks  which  are  important  to 
them  as  one  factor  in  the  successful  implementation  of  end-user  computing  systems 
[Ref.l4:p.  783].  Doll  and  Torkzadeh  state  that  ease  of  use,  content  (information 
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contained  in  the  system),  accuracy,  format,  and  timeliness  are  among  the  components 
which  determine  end-user  satisfaction  [Ref.  15:p.  268]. 


CO.I.-IJ  Cl.i.TJ 


Operation 

Dimension 


Figure  1.  User  Cube  [Ref.  13:p.  1316] 


Rivard  and  Huff  propose  several  success  factors  for  end-user  computing  in  a 
study  of  user  development  of  computer-based  applications  within  an  organization.  Among 
the  factors  they  found  to  have  an  effect  are;  (1)  perceived  user  firiendliness,  (2)  positive 
user  attimde,  (3)  computer  background  of  the  user,  and  (4)  organizational  support.Overall 
satisfaction  was  most  closely  related  to  the  support  provided  by  the  Data  Processing 
Department  of  the  organization.  [Ref.  16:pp.  553-558] 

Rivard  states  that  contributors  to  user  satisfaction  in  organizations  fall  into  two 
groups:  (1)  technological  factors  and  (2)  organizational  factors.  The  technological  factors 
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are  user  friendliness  of  the  software  tools,  environmental  conditions,  and  support  provided 
to  users.  Elements  of  user  friendliness  include  a  requirement  that  the  user  learn  only  a 
few  new  concepts  and  key  words  to  start;  meaningful,  helpful  error  messages;  and  high 
quality  user’s  manual.  Organizational  factors  consist  of  Information  Systems  (IS) 
management’s  readiness  for  change,  users’  attitude  toward  end-user  computing,  and  users’ 
independence  from  the  IS  department.  [Ref.  4:pp.  26-27] 

D.  MIS  CASE  STUDY  LITERATURE 

MIS  research  does  not  readily  conform  to  the  traditional  techniques  of  quantitative 
analysis.  The  literature  reviewed  supports  the  use  of  case  study  research  as  a  viable 
alternative.  [Refs.  17, 18]  A  "case  study"  is  described  by  Benbasat,  Goldstein  and  Mead 
as  follows: 

A  case  study  examines  a  phenomenon  in  its  natural  setting,  employing  multiple 
methods  of  data  collection  to  gather  information  from  one  or  a  few  entities.. ..The 
boundaries  of  the  phenomenon  are  not  clearly  evident  at  the  outset  of  the 
research  and  no  experimental  control  or  manipulation  is  used.  [Ref.  17;p.  370] 

They  cite  several  reasons  for  dissatisfaction  with  MIS  research  information  obtained 

through  quantitative  techniques.  The  complexity  of  multivariate  research  methods  and  the 

distribution  restrictions  inherent  in  the  use  of  these  methods  (the  requirement  for 

distributional  normality)  are  two  of  the  reasons.  Others  are  the  large  sanq}le  sizes  which 

the  methods  dictate  and  the  difficulty  interpreting  the  results  of  studies  in  which  these 

methods  are  used.  [Ref.  17:p.  369]  Because  information  systems  are  in  a  state  of  constant 

technological  change  and  innovation,  researchers  can  best  learn  by  studying  iruiovations 

of  practitioners  to  form  the  basis  for  the  development  of  prescriptive  guidelines.  [Ref. 
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17:p.  3''0]  Case  study  research  is  a  viable  information  system  research  strategy  because: 

(1)  the  researcher  can  study  the  IS  in  a  natural  setting  and  generate  theories  from  practice, 

(2)  the  researcher  can  understand  the  nature  and  complexity  of  the  processes  involved, 
and  (3)  it  is  an  appropriate  way  to  research  an  area  of  which  few  studies  have  been  done. 
[Ref.  17:p.  370] 

Lee  also  supports  the  use  of  case  studies  as  a  methodology  of  MIS  research.  Using 
the  standards  of  the  natural  science  model  for  testing  theories,  he  cites  four  problems 
when  conducting  MIS  research  as  a  case  study  and  responds  to  each.  First,  it  is  difficult 
to  make  controlled  observations  in  an  MIS  study.  Lee  suggests  using  natural  controls 
existing  in  the  environment  under  study.  Second,  making  controlled  deductions  is 
complicated  by  the  usually  qualitative  nature  of  the  data.  His  response  is  that,  because 
mathematics  is  a  subset  of  formal  logic,  qualitative  predictions  are  therefore  logically 
valid  and  acceptable  in  lieu  of  quantitative  predictions.  Third,  the  researcher  cannot 
replicate  a  sequence  of  events  to  verify  his  findings.  Lee  states  that,  although 
observations  caruiot  be  precisely  replicated,  findings  can  be.  Fourth,  the  unique  events 
in  the  study  of  a  case  make  it  difficult  or  impossible  to  extend  findings  to  other  settings. 
To  resolve  this  problem  of  generalizability,  a  theory  must  have  been  tested  and  confirmed 
in  a  variety  of  situations  before  being  generalized.  [Ref.  18:pp.  35-40] 

E.  SUMMARY 

Table  1  sununarizes  the  literature  reviewed  for  this  study. 
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Issue 


Reference 


Lewin-Schein  Model 

Srinivasan/Davis  [Ref.  2] 

Kolb-Frohman  Model 

Srinivasan/Davis  [Ref.  2] 

Effect  of  Organizational  Factors 

Lucas  [Ref.  6] 

Lyytinen  [Ref.  7] 

De  sanct i s /Court ney 
[Ref.  8] 

Markus  [Ref.  9] 

Effect  of  Planning 

Rivard  [Ref.  4] 

Dynamic  Nature  of  Implementation 

Ginzberg/Schultz  [Ref.  3] 

Reasons  for  IS  Failure 

Lucas  [Ref.  6] 

Effect  of  User  Participation 

Baroudi /Olson/ Ives 
[Ref.  10] 

Lucas  [Ref.  6] 

Effect  of  User  Attitude 

Lucas  [Ref.  6] 
Desanctis/Courtney 
[Ref.  8] 

Implementation  Process  Models 

Srinivasan/Davis  [Ref.  2] 
Leonard-Barton  [Ref.  12] 

Receptiveness  to  Innovation 

Leonard-Barton  [Ref.  12] 

Classification  of  End-Users 

Rockart /Flannery  [Ref.  14] 
Cotterman/Kumar  [Ref.  13] 
Doll/Torkzadeh  [Ref. 15] 

User  Cube 

Cotterman/Kumar  [Ref.  13] 

Implementation  Success  Factors 

Rockart /Flannery  [Ref.  14] 
Doll/Torkzadeh  [Ref.  15] 
Rivard/Huff  [Ref.  16] 

Rivard  [Ref.  4] 

MIS  Case  Study  Research 

Benba5  'Goldstein/Mead 
[Rf  '  17] 

Lee  [Rti..  18] 

Table  1.  Summary  of  Literature  Review 
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m.  OVERVIEW  OF  THE  ELECTRONIC  FILING  SYSTEM 


A.  HISTORY 

The  IRS  has  experienced  a  trend  toward  increasing  numbers  of  paper  returns  and 
accompanying  documentation  received  for  processing  at  its  service  centers.  The  result 
has  been  concomitant  increases  in  costs  for  storage  space,  processing  and  personnel  to 
handle  the  volumes  of  paper.  In  an  effort  to  control  costs  and  make  the  processing  of  tax 
returns  more  efficient,  the  IRS  has  developed  a  system  which  provides  for  the  electronic 
filing  of  returns. 

In  1986,  the  IRS  Research  Division  introduced  a  pilot  Electronic  FUing  System 
(EFS)  program  in  three  metropolitan  areas  of  Ohio,  Nordi  Carolina  and  Arizona. 
Participants  in  the  program  filed  25,000  Individual  Federal  Income  Tax  Returns.  The 
system  was  considered  a  success  and  became  operational  in  1987.  [Ref.l] 

In  each  subsequent  year  the  program  expanded  to  include  more  participants  in  a 
wider  geographic  area,  more  forms  and  schedules  which  could  be  filed  electronically,  and 
more  returns  filed  using  EFS.  The  IRS  introduced  electronic  filing  of  Business  Returns 
as  a  pilot  program  in  1987  and  electronic  filing  of  Employee  Plans  Returns  in  1988.  In 
1989  the  EFS  office  assumed  direction  of  both  these  programs  from  the  Research 
Division.  The  1990  filing  season  was  the  first  in  which  aU  50  states  were  able  to 
participate.  Electronic  filing  of  balance  due  returns  was  introduced  in  1991  in  ten  states. 
[Ref.  1] 
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The  San  Jose  District  became  part  of  the  system  in  1988.  Returns  filed  in  the  first 
year  totalled  10,600;  in  the  second  year,  17,900  returns  were  filed.  In  1990,  38,000 
returns  were  filed  electronically  in  the  San  Jose  District,  an  increase  of  more  than  100 
percent  over  1989.  Electronically  filed  returns  accounted  for  4.7  percent  of  the  total 
number  of  returns  requiring  refunds.  [Ref.  19] 

B.  TERMINOLOGY 

Two  difierent  references  to  time  periods  are  used  in  this  study.  "Tax  year"  refers 
to  the  calendar  year  for  which  income  tax  is  paid  or  withheld.  For  example,  the  1989  tax 
year  is  January  1,1989,  to  December  31, 1989.  "Filing  season"  refers  to  the  period  during 
which  tax  returns  are  filed,  normally  January  to  April  15  of  one  year.  For  exan^le,  the 
1990  filing  season  refers  to  the  period  of  time  between  January  1990  and  April  15,  1990, 
when  returns  for  tax  year  1989  are  filed. 

The  different  types  of  electronic  filers  are  defined  as  follows.  (All  are  considered 
"tax  practitioners.")  A  "preparer"  fills  in  the  electronic  return  and  computes  the  tax  based 
on  information  the  taxpayer  provides.  A  "transmitter"  transmits  returns  directly  to  the 
IRS.  A  "preparer/transmitter"  performs  the  same  role  as  a  preparer  and  also  transmits  the 
return  directly  to  the  IRS.  A  "service  bureau"  is  a  tax  return  processor  who  provides  a 
variety  of  services,  including  collection  or  transmittal  of  returns  to  the  IRS.  An 
"electronic  return  collector"  accepts  prepared  returns  directly  from  taxpayers  from  which 
it  produces  electronic  returns.  [Ref.  20;p.  8]  A  comprehensive  glossary  of  terms  and 
acronyms  used  in  this  paper  is  contained  in  Appendix  A. 
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C.  EFS  CONCEPT 


1.  DeHnition  of  Electronic  Filing 

Electronic  Filing  (EF)  is  defined  by  the  IRS  as  "...the  receipt  and  processing 
of  tax  returns  using  electronic  records."  [Ref.  21:pp.  1-2]  EF  is  designed  to  offer 
advantages  to  taxpayers,  tax  practitioners,  and  the  IRS.  Taxpayers  should  benefit  from 
faster  processing  of  returns  and,  therefore,  faster  receipt  of  refunds.  Tax  practitioners  who 
offer  the  service  should  have  a  competitive  advantage  over  those  who  do  not.  The  IRS 
should  benefit  from  reduced  costs  for  processing,  storage  and  retrieval  of  tax  returns. 
[Ref.  22] 

In  addition  to  requiring  less  time  to  process,  electronic  returns  have  a  higher 
accuracy  rate  than  paper  returns.  The  error  rate  for  electronic  renuns  filed  during  the 
1989  filing  season  was  jq)proximately  three  percent,  while  paper  returns  averaged  about 
16  percent.  The  IRS  attributes  the  lower  error  rate  foir  electronic  returns  to  the  electronic 
filing  software  which  verifies  the  accuracy  of  the  returns  before  transmission.  [Ref.  20] 
Figure  2  compares  psqier  and  electronic  return  processing. 

2.  Process  Overview 

The  procedure  for  filing  electronically  is  as  follows.  A  tax  preparer  or 
transmitter  desiring  to  use  EFS  allies  for  admission  into  the  program.  The  IRS  performs 
a  suitability  check  of  the  applicant  to  determine  whether  the  applicant  has  a  history  of 
Internal  Revenue  Code  violations  or  other  problems  with  the  IRS  which  cast  doubt  on  the 
integrity  or  ability  of  the  applicant  to  participate  in  the  EFS  program. 
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Figure  2.  Comparison  of  Paper  and  Electronic  Tax  Processing 
[Ref.  20] 


Following  the  suitability  check,  ^}plicants  are  assigned  an  Electronic  Filer 
Identification  Number  (EFIN).  Software  developers  and  direct  transmitters  must 
successfully  complete  acceptance  testing  before  being  accepted  into  the  program.  [Ref. 
20] 

Return  data  is  processed  by  the  IRS  and,  if  valid,  an  acknowledgement  file 
is  sent  to  the  transmitter.  The  return  data  is  formatted  and  merged  with  paptt  return  data 
on  tape  for  the  release  of  refunds.  Error  *'^e  returns  are  archived  to  optical  disk.  Returns 
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requiring  corrections  are  temporarily  stored  on  disk  from  which  tax  examiners  make 
corrections  on  a  shadow  page  of  the  return.  [Ref.  21] 

Electronic  returns  are  processed  at  one  of  three  service  centers  whose  areas 
of  responsibility  are  geographically  determined.  The  Andover  Service  Center  in 
Massachusetts  serves  the  Northeast  and  Middle  Atlantic  states.  The  Cincinnati  Service 
Center  in  Ohio  serves  the  South  and  eastern  part  of  the  Midwest.  The  Ogden  Service 
Center  in  Utah  serves  the  western  part  of  the  Midwest  and  the  West.  District  Offices 
processed  by  a  Service  Center  are  responsible  for  coordinating  the  EPS  program  within 
their  assigned  area,  providing  training  to  and  interfacing  directly  with  users.  [Ref.  20] 

3.  EFS  Components 

The  Electronic  Filing  System  in  each  Service  Center  consists  of  three 
subsystems:  the  Data  Communications  Subsystem,  the  Processing  Subsystem,  and  the 
Archival/Retrieval  Subsystem.  [Ref.  21]  The  functions  of  the  subsystems  are  described 
in  the  following  paragraphs. 

The  Data  Communications  Subsystem  includes  both  dial-up  and  leased 
(dedicated)  modems.  Electronic  returns  are  transmitted  via  modem  to  an  IBM  Series/1 
communications  processor  which  receives  the  tax  data  and  stores  it  to  a  uniquely  named 
disk  file.  [Ref.  21] 

The  Processing  Subsystem  is  composed  of  a  UNISYS  1180  mainframe 
computer  and  software  which  formulate  and  validate  the  information  received  by  the  Data 
Communication  Subsystem.  This  subsystem  processes  the  electronically  filed  tax  data  to 
mesh  with  key  entered  tax  data.  [Ref.  21] 
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The  Archival/Retrieval  subsystem  consists  of  a  Network  Server  (File 
Manager),  an  Optical  Disk  Manager,  several  Forms  Processing  Workstations,  and  a  Print 
Subsystem.  The  Network  Server  is  comprised  of  both  disk  and  tape  drives.  The  server 
stores  all  active  returns  and  assigns  and  prioritizes  work  for  tax  examiners  who  make 
adjustments  to  the  returns.  The  Optical  Disk  Manager  transfers  error-free  returns  to 
optical  disk  for  long-term  storage.  Forms  Processing  Workstations  are  personal  computers 
on  which  tax  examiners  check  and  make  corrections  to  a  shadow  page  of  an  electronic 
return.  The  Print  Subsystem  consists  of  laser  printers  which  provide  the  capability  to 
print  paper  copies  of  electronically  fried  returns  if  necessary.  [Ref.  21] 
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IV.  SURVEY  DATA  AND  STATISTICAL  ANALYSIS 


A.  DESCRIPTION  OF  DATA 

The  data  which  was  used  in  this  analysis  was  published  in  two  fonns  by  the  IRS. 
Data  on  the  number  of  returns  submitted,  accepted  and  rejected;  the  refund  amount;  and 
the  percentage  of  rejected  returns  for  each  filer  in  the  San  Jose  district  was  contained  in 
the  Electronic  Filing  Report  produced  by  the  Ogden  Service  Center.  Additional  data  was 
available  from  surveys  which  the  district  EPS  Coordinator  mailed  to  all  individuals  or 
firms  which  had  EFINs.  Two  surveys  were  used:  one  which  addressed  the  1989  filing 
season  and  one  which  addressed  the  1990  filing  season. 

1.  Electronic  Filing  Report 

The  Electronic  Filing  Report  is  produced  and  distributed  weekly  during  the 
filing  season  and  lists  year-to-date  filing  statistics  on  electronic  filers  in  the  San  Jose 
district.  It  is  arranged  in  columnar  format  and  includes  the  following  information  for  each 
individual  or  firm  which  filed  at  least  one  return  electronically  during  the  1990  filing 
season;  EFIN,  Originator  Name,  Transactions  (Returns),  Acceptances,  Rejections, 
Duplicate  Returns,  Expected  Refund  Amormt,  and  Percentage  of  Rejected  Transactions. 

The  EFIN,  Transactions,  Expected  Refund  Amount  and  Rejection  Percentage 
were  used  in  the  statistical  analysis  for  this  study.  The  Originator  Name,  in  combination 
with  the  EFIN,  was  used  to  link  the  data  from  the  report  to  the  information  obtained  fiom 
the  surveys. 
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The  EFIN  is  a  six  digit  code  number  which  uniquely  identifies  each  electronic 
filer.  The  first  two  digits  of  each  EFIN  are  "77"  which  is  the  code  for  the  San  Jose 
District.  Once  assigned,  the  individual  or  firm  uses  the  same  EFIN  from  year  to  year. 
Transactions  are  the  year-to-date  total  of  the  number  of  returns  filed  electronically  under 
an  EFIN.  Expected  Refund  Amount  is  the  year-to-date  total  amount  of  the  refunds  for 
returns  filed  electronically  under  an  EFIN.  Rejection  Percentage  is  the  quotient  of  the 
number  of  returns  rejected  divided  by  the  total  number  of  returns  filed  electronically. 

2.  Surveys 

The  format  of  the  two  surveys  was  similar,  but  the  questions  asked  on  each 
were  different.  Questions  generally  required  either  a  positive  response,  if  the  question 
applied  to  the  filer,  or  no  response.  Comments  were  solicited  for  most  questions.  The 
questionnaires  are  reproduced  in  Appendix  B. 

B.  SELECTION  OF  SUBJECTS 
1.  Subject  Selection  Method 

Subjects  for  each  of  the  two  surveys  included  all  firms  and  individuals  in  the 
San  Jose  district  who  held  an  EFIN  during  the  filing  season  corresponding  to  the  survey 
year.  Subjects  for  the  Electronic  Filing  report  included  all  firms  or  individuals  in  the  San 
Jose  district  who  filed  at  least  one  return  electronically  during  the  1990  filing  season. 
The  subject  pool  for  the  Electronic  Filing  report  was,  therefore,  a  subset  of  the  subject 
pool  for  the  1990  survey. 
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2.  Geographical  Distribution  of  Sample 

The  sample  data  which  was  collected  and  analyzed  for  this  study  was  drawn 
from  the  geographic  area  of  responsibility  of  the  San  Jose  district  office  of  the  IRS.  The 
San  Jose  district  is  responsible  for  an  area  of  central  California  bounded  by  Menlo  Park 
on  the  northwest,  Mono  Lake  on  the  northeast,  Edwards  Air  Force  Base  on  the  soudieast 
and  Port  Hueneme  on  the  southwest. 

C.  SURVEY  RESPONSE  RATE 

The  1989  survey  questionnaire  was  mailed  to  450  Electronic  Filing  tax  preparers 
who  were  accepted  into  the  program  for  the  1989  filing  season.  There  were  234 
responses  as  of  July  27, 1989,  a  52  percent  tesponse  rate.  The  1990  survey  questionnaire 
was  mailed  to  650  Electronic  Filing  tax  preparers  who  were  accepted  into  the  program 
for  the  1990  filing  season.  There  were  373  re^nses  as  of  July  20,  1990,  a  57  percent 
response  rate. 

D.  IRS  SUMMARY  OF  SURVEY  RESPONSES 

Summaries  of  the  responses  to  the  1989  and  1990  surveys  are  reproduced  in 
Appendix  B.  The  San  Jose  district  EFS  Coordinator  produced  the  summaries.  The  IRS 
analysis  of  the  data  included  a  listing  of  the  comments  that  survey  respondents  made  to 
each  question,  in  addition  to  the  response  summaries.  The  1990  survey  report  also 
included  a  summary  of  the  reasons  respondents  cited  for  not  using  electronic  filing  during 
the  1990  filing  season. 
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E.  STUDY  ANALYSIS 


1.  Problem  Definition 

Two  problems  are  addressed  in  this  study:  the  high  error  rate  for  scmie 
electronic  filers  and  the  low  participation  rate  in  EPS  in  the  San  Jose  District.  Both 
problems  can  be  considered  symptomatic  of  the  degree  of  success  of  the  implementation 
of  electronic  filing  by  the  IRS. 

The  reason  for  the  differences  in  error  rate  among  filers  is  not  readily 
discemable.  Experience  level  of  filers  varies,  as  well  as  the  software  and  transmission 
methods  they  use.  The  partic^ation  rate  can  be  affected  by  many  factors.  The 
multiplicity  of  stakeholders  who  are  also  users  of  the  system  complicates  the  examination 
of  factors  influencing  participation.  These  stakeholders  include  taxpayers,  tax  preparers, 
third  party  transmitters,  and  electronic  filing  technicians  at  the  IRS.  The  interests  and 
priorities  of  each  group  of  stakeholders  are  different  and,  while  not  necessarily 
conflicting,  make  determination  of  an  effective  strategy  of  implementation  a  complex 
issue.  Statistical  analysis  was  used  to  investigate  possible  reasons  for  differences  in 
filers’  error  rates  and  is  discussed  in  Section  3  below. 

The  implementation  of  EPS  is  unique  in  diat  it  is  not  used  within  a  single 
organization.  It  was  implemented  by  the  IRS  to  be  used  by  the  IRS  itself  and  by 
organizations  independent  of  the  IRS.  Use  of  EPS  by  tax  practitioners  is  voluntary; 
support  may  be  provided  to  users  from  within  their  own  organizations  as  well  as  from  the 
IRS.  The  participation  rate  is  discussed  in  Chapter  V  using  a  case  study  {q>proach. 
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2.  Discussion  of  Survey  Responses 

Examination  of  the  responses  to  the  1989  and  1990  IRS  surveys  revealed  that 
problem  areas  reported  by  respondents  were  different  in  1989  than  in  1990.  Direct 
comparison  of  all  categories  is  not  possible  because  different  questions  were  asked  on  the 
two  surveys.  Figiue  3  graphs  the  number  of  respondents  reporting  problems  in  four  areas 
in  1989.  Problems  with  transmitter  were  most  often  noted.  Figure  4  grq>hs  the  reported 
problems  in  1990.  Software  problems  were  most  often  reported,  followed  by  cost. 


EFS  PROBLEM  AREAS 
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Problem  Areas 


Figure  3.  Problem  Areas-1989 
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EF5  PROBLEM  AREAS 
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Figure  4.  Problem  Areas»1990 

Figure  5  compares  1989  and  1990  responses  in  the  areas  of  transmitter  and 
software  problems,  the  only  two  problem  areas  addressed  in  both  surveys.  In  1989,  24 
percent  of  respondents  reported  problems  with  transmitters  compared  with  six  percent  in 
1990.  Software  problems  were  reported  by  14  percent  of  respondents  in  1989  and  by  10 

P 

percent  in  1990.  In  general,  proportionately  fewer  respo....ents  had  problems  with  eidier 
transmitters  or  software  in  1990.  This  decrease  may  be  attributed  to  increasing  familiarity 
of  users  with  the  system  or  to  improvements  made  in  the  transmitters  and  the  software. 

The  surveys  yielded  information  on  individual  transmitters  with  which 
respondents  had  trouble.  Figure  6  shows  the  three  most  trouble  prone  transmitters  in 
1989  were  Unitax,  ELF,  and  Compucraft.  In  1990,  as  shown  in  Figure  7,  Lacerte, 
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TRANSMITTER  PROBLEMS 

1990  SURVEY 


Transmitter  Name 


Figure  6.  Transmitter  ProbleniS"1989 
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Flashtax,  and  Instatax  were  most  often  reported  by  respondents  as  causing  problems. 
(Lacerte  contracted  electronic  filing  to  Flashtax  in  1990;  problems  survey  respondents 
reported  with  Lacerte,  therefore,  may  have  been  related  to  the  Flashtax  transmitter.)  No 
transmitter  can  be  singled  out  as  causing  significant  problems  in  both  1989  and  1990.  (It 
should  be  noted  that  the  survey  data  is  historic  and  the  analysis  does  not  predict  the 
quality  of  future  performance  of  any  transmitter.) 

TRANSMITTER  PROBLEMS 

1990  SURVEY 


Nurrter  of  fteapondenla  btovtng  Prdbl 


Figure  7.  Transmitter  ProbieniS”1990 

As  a  transmitter,  Compucraft  improved  its  position  considerably  between  1989 
and  1990,  earning  not  one  complaint  in  1990  and,  as  shown  in  Figure  8,  was  the  most 
widely  used  and  most  highly  recommended  transmitter  in  the  1990  survey.  Flashtax  and 
Lacerte  were  the  next  most  widely  used  transmitters  but  received  "Not  recommended" 
responses  from  a  majority  of  their  users.  (Lacerte  contracted  electronic  filing  to  Flashtax 
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in  1990;  problems  survey  respondents  reported  with  Lacerte,  therefore,  may  have  been 
related  to  the  Flashtax  transmitter.) 


EFS  TRANSMITTERS 

1990  SURVEY 
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Trariemittor  Nama 


CinciudM  tranaaiittars  uMd  by  mor«  than 
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Figure  8.  Transmitter  Recomniendations-1990 


Software  problems  reported  on  the  two  surveys  are  grq)hed  in  Figures  9  and 
10.  In  both  1989  and  1990,  more  respondents  reported  problems  witii  Lacerte  than  with 
any  other  software.  (It  should  be  noted  that  the  survey  data  is  historic  and  the  analysis 
does  not  predict  the  quality  of  future  perfoimance  of  any  software.) 

Figure  11  graphs  the  distribution  of  respondents’  usage  of  EFS  in  1989  and 
1990.  A  higher  percentage  of  respondents  filed  electronically  in  1990  than  in  1989,  but 
the  proportion  of  direct  filers  did  not  increase. 
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SOFTWARE  PROBLEMS 
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Figure  9.  Software  Problems— 1989 
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Figure  11.  EFS  Usage~1989  and  1990 


3.  Summary  of  Study  Statistical  Analysis 
a.  Data  Interpretation  Methods 

Data  contained  in  the  Electronic  Filing  Report  and  in  the  survey  responses 
were  analyzed  separately  and,  where  possible,  in  combination  to  determine  whedier  a 
significant  predictor  could  be  found  for  the  rejection  percentage.  In  most  cases  the  survey 
respondent’s  name  and  address  was  on  the  mailing  label  on  the  survey  questionnaire  and 
could  be  used  to  ascertain  the  respondent’s  EFIN  from  an  alphabetical  list  of  EFIN 
holders.  Information  from  the  survey  could  thereby  be  con^pared  to  information  on 
rejection  percentage  and  number  of  returns  filed  in  the  Electronic  Filing  report.  The 
statistical  con^uter  package  Minitab  was  used  to  perform  the  analysis.  A  detailed 
description  of  the  analysis  is  included  in  Appendix  C;  a  summary  follows. 


b.  Regression  Analysis 

A  regression  analysis  was  performed  to  determine  how  much  of  the 
variation  in  rejection  percentage  could  be  accounted  for  by  EFIN  and  number  of  returns 
submitted  electronically.  The  Electronic  Filing  Report  was  the  source  of  the  data  so  the 
analysis  q)plied  to  1990  filers  only.  The  EFIN  was  selected  as  a  possible  predictor 
because  EFINs  are  assigned  consecutively  and  cany  over  hum  year  to  year  so  a  lower 
EFIN  indicates  longer  involvement  with  the  program  and,  potentially,  more  interest  in  or 
more  extensive  knowledge  of  electronic  filing.  The  magnitude  of  the  EFIN,  however, 
does  not  indicate  how  much  experience  the  filer  has  had  with  the  program;  therefore,  the 
number  of  returns  filed  electronically  was  selected  as  a  second  possible  predictor. 
Following  the  regression  analysis,  graphs  of  the  relationsh^  of  EFIN  to  rejection 
percentage  and  number  of  returns  submitted  to  rejection  percentage  were  plotted  and 
examined  to  determine  whether  a  relationship  other  than  linear  might  exist. 

The  regression  analysis  resulted  in  a  coefficient  of  determination  of  3.6 
percent  which  indicates  that  very  little  of  the  variation  in  die  percentage  of  rejections  can 
be  accounted  for  by  EFIN  and  number  of  returns  filed  electronically.  However, 

r 

subsequent  examination  of  the  graph  of  rejection  percentage  as  a  function  of  number  of 
returns  submitted  (Figure  12)  revealed  that  the  plot  approximates  a  curve  which  indicates 
that  the  percentage  of  rejections  drops  off  shaiply  as  the  number  of  returns  submitted 
approaches  500  and  more  slowly  beyond  500,  approaching  zero  as  die  number  of  returns 
increases.  It  tqipears,  therefore,  that  the  number  of  returns  submitted  may  be  a  predictor 
of  rejection  percentage  in  that  the  more  returns  submitted  by  an  EFIN,  the  lower  the 
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percentage  of  rejections.  This  does  not  mean  that  filers  who  submit  relatively  few  returns 
will  necessarily  have  high  rejection  percentages.  Of  252  filers  who  filed  fewer  than  SO 
returns,  88  (35  percent)  had  no  rejections.  In  general,  however,  a  filer  who  submits  a 
large  number  of  returns  (more  than  500)  can  be  expected  to  have  a  relatively  low  (less 
than  ten  percent)  percentage  of  rejections. 
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Figure  12.  Plot  of  Rejection  Percentage  as  a  Function  of  Number  of 
Returns  Submitted. 


c.  Hypothesis  Tests 

The  hypothesis  tests  which  were  performed  during  the  analysis  assume 
a  normally  distributed  population.  The  population  of  rejection  percentages  from  the 
Electronic  Filing  Report  is  not  normally  distributed,  as  shown  in  the  histogram  in  Figure 
13.  Consequently,  the  results  of  hypothesis  tests  which  compare  sample  means  to  the 
mean  of  the  population  of  rejection  percentages  may  not  be  conclusive  but  are  included 
for  information. 
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Figure  13.  Histogram  of  Rejection  Percentages. 


(1)  Transmission  Method.  Hypothesis  tests  were  perfoimed  to 
detemiine  whether  the  method  of  transmission  used  by  an  electronic  filer  (filing  directly 
or  through  a  third  party  transmitter)  resulted  in  significantly  higher  or  lower  rejection 
percentage  than  the  population  of  all  filers.  A  hypothesis  test  was  also  performed  to 
determine  whether  direct  filers  had  a  lower  percentage  of  rejections  than  filers  who  used 
third  party  transmitters.  Data  on  the  method  of  transmission  was  obtained  from  the  1990 
survey  and  linked  to  rejection  percentage  on  the  Electronic  Filing  report  through  the 
EFIN. 

Neither  direct  filers  nor  filers  using  third  party  transmitters  had 
significantly  lower  or  higher,  respectively,  rejection  percentages  than  the  population  of 
all  1990  filers.  Direct  filers  did  have  a  lower  percentage  of  rejections  at  a  ten  percent 
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significance  level  than  users  of  third  party  transmitters;  however,  the  number  of  returns 
submitted  by  direct  filers  is  greater  than  the  number  of  returns  submitted  by  users  of  third 
party  transmitters  at  a  five  percent  significance  level.  The  difference  in  error  rates  may 
therefore  be  a  result  of  the  volume  of  returns  filed  and  not  the  method  of  transmission. 

(2)  Two  Year  Filers.  In  order  to  determine  whether  filers  who  used 
electronic  filing  in  both  1989  and  1990  had  a  lower  percentage  of  rejections  than  the 
population  of  all  1990  filers,  a  hypothesis  test  was  performed  to  compare  the  mean  of  the 
sample  of  two  year  filers  to  the  population  mean.  The  sample  included  all  filers  who 
responded  to  both  the  1989  and  1990  surveys,  who  indicated  on  the  1989  survey  that  they 
filed  in  1989,  and  who  were  listed  in  the  Electronic  Filing  Report  as  filing  in  1990.  The 
EFIN  was  again  used  to  link  the  survey  information  to  the  Electronic  Filing  Report. 

Filing  in  two  consecutive  years  does  not  qrpear  to  have  a  significant 
effect  on  the  rejection  percentage.  At  a  five  percent  significance  level,  test  data  did  not 
provide  sufficient  evidence  to  conclude  that  filers  who  filed  in  both  1989  and  1990  had 
a  lower  percentage  of  rejections  than  the  population  as  a  whole. 

(3)  Problems  with  Software.  The  rejection  percentages  for  1990  survey 
respondents  who  reported  problems  with  software  were  analyzed  using  hypothesis  tests 
to  determine  whether  users  of  the  most  trouble-prone  software  had  higher  rejection 
percentages  than  the  population  of  all  filers.  Only  software  reported  by  five  or  more 
respondents  was  considered;  therefore,  only  Flashtax  and  Laceite  are  included  in  the 
analysis. 
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Five  or  more  users  reported  having  problems  using  Flashtax  or 
Lacerte  software  in  1990.  At  a  five  percent  significance  level,  test  results  did  not  provide 
sufficient  evidence  to  conclude  that  filers  who  had  problems  with  Flashtax  or  Lacerte 
software  had  a  higher  rejection  percentage  than  the  population. 

(4)  Third  Party  Transmitters.  Similarly,  the  rejection  percentages  for 
1990  survey  respondents  who  reported  using  third  party  transmitters  were  analyzed  to 
determine  whether  the  transmitter  affected  the  rejection  percentage.  Only  transmitters 
used  by  five  or  more  respondents  were  considered;  Compucraft,  CSC-TACS,  Lacerte  and 
Flashtax. 

The  choice  of  third  patty  transmitter  may  have  an  effect  on  the 
percentage  of  returns  rejected.  At  a  five  percent  significance  level,  Flashtax  users  had  a 
higher  rejection  percentage  than  the  population.  At  a  ten  percent  significance  level, 
however,  Lacerte  and  CSC-TACS  users  also  had  higher  rejection  percentages  while 
Compucraft  users  had  a  lower  percentage  of  rejected  returns.  (It  should  be  noted  that 
Lacerte  used  Flashtax  to  transmit  electronic  returns  in  1990.) 
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V.  IMPLEMENTATION  OF  EFS-A  CASE  STUDY 


A.  APPLICABILITY  OF  CASE  STUDY  APPROACH 

The  articles  by  Lee  [Ref.  18]  and  Benbasat,  Goldstein,  and  Mead  [Ref.  17] 
discussed  in  Chapter  n  support  the  use  of  a  case  study  qrproach  to  MIS  research.  This 
approach  is  ^>plicable  to  this  study  for  a  number  of  reasons.  Benbasat,  Goldstein,  and 
Mead  cite  the  complexity  of  multivariate  research  methods  and  the  requirement  for  a 
normal  distribution  as  two  reasons  for  using  case  study  [Ref.  17:p.  369].  The  absence  of 
distributional  normality  in  the  study  data  was  discussed  in  Chapter  IV.  Without 
qualitative  analysis,  it  is  difficult  to  develop  a  meaningful  interpretation  of  the  results  of 
the  quantitative  analysis.  This  case  study  is  intended  to  expand  on  the  information 
gleaned  from  the  statistical  analysis  in  discussing  the  participation  rate  in  EFS. 

B.  CLASSIFICATION  OF  USERS 

Implementation  of  EFS  involves  many  difrerent  categories  of  users  in  many 
different  organizations.  Different  users  include  taxpayers,  preparers,  managers  of  a  firm 
which  files  returns  electronically  (filer  management),  IRS  return  processing  technicians, 
and  IRS  managers.  Using  Cotterman  and  Kumar’s  user  cube  [Ref.  13:p.  1316]  to  classify 
system  users  shows  how  diversely  distributed  the  various  users  are  (Figure  14). 
(Although  preparers  and  IRS  technicians  are  represented  by  the  same  point,  their 
involvement  is  with  entirely  different  equipment,  hence,  each  is  located  at  the  midpoint 


of  the  operation  dimension.)  Successfully  (tesigning  and  in^lementing  a  system  to  satisfy 
such  a  diversity  of  users  is  understandably  a  difficult  task. 
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Figure  14.  Taxonomy  of  EFS  Users 


C.  IMPLEMENTATION  PROCESS 

Srinivasan  and  Davis  state  that  introduction  of  ne’  ,  ^chnologies  and  diversity  of 
user  types  necessitate  a  process  of  implementation  in  which  the  implementors  act  as 
facilitators  and  coaches  [Ref.  2:p.  67].  Comments  of  survey  respondents  indicate  that 
their  perception  of  the  IRS’s  implementation  process  is  more  authoritative  than 
facilitating,  and  that  they  would  prefer  the  latter  s^proach.  Boehm  and  Ross  have 
proposed  an  q>proach  to  management  which  they  call  Theory  W;  its  fundamental 
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principle  is,  "Theory  W:  Make  EvetyoiM  a  Winner."  [Ref.  23:p.  902]  Survey 
respondents  seemed  to  favor  a  process  which  acknowledged  the  variety  of  users  and  their 
different  needs  and  responded  to  each  in  a  positive  way,  akin  to  qjplying  Theory  W  to 
management  of  EPS  by  the  IRS. 

D.  REASONS  FOR  NOT  USING  EFS 

The  comments  offered  by  survey  respondents  provide  insight  into  the  perceived 
reasons  for  success  of  EFS  from  the  preparers’  perspective.  The  reasons  for  not  using 
EFS  in  1990  can  be  broken  down  into  six  general  areas,  displayed  gr{q)hically  in  Figure 
15.  The  most  significant  reason— no  client  interest— includes  both  disinterest  by  clients 
of  preparers  and  lack  of  qualified  clients,  either  because  they  did  not  receive  refunds  or 
because  their  returns  required  forms  which  EFS  could  not  handle.  Cost  was  another 
frequency  mentioned  reason  for  not  using  EFS.  Comments  indicated  tiiat  some  preparers 
felt  the  program  was  not  cost  effective  or  that  the  cost  to  clients  was  too  high. 

E.  SUCCESS  FACTORS 

Literature  discussed  in  Oiqrter  n  suggests  several  factors  for  success  in  die  areas 
of  end-user  computing  and  implementation  of  management  information  systems.  Among 
the  success  factors  which  s^ply  to  EFS  are  the  following:  (1)  planning,  (2)  user 
participation,  (3)  user  attitude,  (4)  cost,  (5)  timeliness,  (6)  technical  quality,  (7)  user 
friendliness  and  ease  of  use,  and  (8)  training. 
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1.  Planning 

Planning  was  mentioned  as  a  success  factor  by  Rivard,  who  emphasized  the 
need  for  careful  planning  in  the  determination  of  users’  requirements  [Ref.  4:p.  33]. 
Careful  planning  might  have  increased  participation  in  EPS  by  making  the  system  meet 
the  needs  of  a  wider  range  of  users.  As  an  example,  survey  respondents  in  1989  and 
1990 

voiced  dissatisfaction  with  the  IRS’s  choice  of  modem  baud  rate  for  transmitters.  Many 
of  these  respondents  had  modems  already  and  balked  at  investing  in  a  4800  or  9600  baud 
modem  only  for  EPS.  Had  these  users  been  able  to  use  the  modems  they  owned,  they 
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could  have  participated  as  direct  filers  who,  as  survey  results  indicate,  file  significantly 
more  returns  than  those  who  use  third  party  transmitters. 

2.  User  Participation 

User  paitic^ation  is  a  success  factor  which  is  related  to  planning  in  that  the 
successful  determination  of  user  requirements  during  planning  is  facilitated  by  the 
participation  of  users  [Refs.  6,10].  Had  users  been  consulted  before  the  required  modems 
were  selected,  for  instance,  a  different  decision  might  have  been  made  which  would  have 
resulted  in  more  preparers’  being  able  to  file  directly.  Lucas  states  that  user  partic4>ation 
in  system  design  ultimately  results  in  high  levels  of  use  [Ref.  6:p.  23].  The  IRS  has 
recognized  the  importance  of  user  participation,  holding  a  Participants’  Information 
Exchange  Day,  for  example,  on  April  26,  1990,  for  26  selected  participants.  The 
conference  "...provided  the  opportunity  for  Electronic  Filing  participants  to  express  their 
opinions  regarding  improvement  of  the  entire  Electronic  Filing  program,  including  testing 
and  processing  at  the  service  centers."  [Ref.  24;p.  2]  The  San  Jose  district  survey  is 
another  indication  that  the  IRS  is  aware  of  the  importance  of  user  participation  in  system 
implementation. 

3.  User  Attitude 

In  discussing  the  importance  of  user  attitude  to  the  successful  implementation 
of  information  systems,  Lucas  states  that,  "Favorable  attitudes  and  perceptions...are 
associated  with  high  levels  of  use  of  information  systems."  [Ref.  6:p.  105]  Desanctis  and 
Courtney  also  emphasized  the  significance  of  user  attitude  [Ref.  8].  When  considering 
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taxpayers  as  users  of  EPS,  it  appears  that  their  attitude  as  a  group  is  not  overwhelmingly 
positive.  Figure  14  indicates  that  the  reason  preparers  cited  most  often  for  not  filing 
electronically  was  a  lack  of  client  interest,  in  some  cases,  clients  were  not  eligible  to  file 
electronically;  but,  in  most  cases,  survey  respondents  commented  that  tfiey  had  no 
requests  to  file  electronically  or  that  clients  were  reluctant  to  use  EPS  because  it  was  too 
costly  or  slower  than  advertised  by  the  IRS.  In  short,  many  taxpayers  could  perceive  no 
advantage  in  using  EPS.  Preparers  as  a  group  seemed  to  be  more  positive;  many  were 
very  enthusiastic  about  EPS  and  its  potential  for  the  future  even  if  they  experienced 
problems  using  the  system.  Not  all  were  in  favor  of  EPS,  however,  such  as  the  preparer 
who  commented  on  the  1990  survey,  "I  discouraged  my  clients  as  it  is  a  financial  ripoff." 
According  to  Leonard-Barton,  implementors  must  build  positive  influences  and  counter 
negative  ones  to  facilitate  acceptance  of  irmovations  [Ref.  12:p.  6].  To  increase  taxpayer 
participation,  many  survey  respondents  suggested  increased  marketing  on  the  part  of  the 
IRS  to  acquaint  taxpayers  with  the  benefits  of  using  EPS,  in  conjunction  with  increased 
effoit  to  fulfill  their  maiketing  promises—specifically,  providing  refunds  as  quickly  as 
advertised. 

4.  Cost 

Cost  was  a  frequently  recurring  complaint  which  affected  users’  attitudes. 
Cost  was  the  second  most  often  cited  reason  on  the  1990  survey  for  not  filing 
electronically.  Reduction  of  costs  was  one  of  the  objectives  for  EPS  [Ref.  20:p.  2],  but 
the  perception  of  survey  respondents  was  that  the  only  stakeholder  enjoying  cost 
reductions  was  the  IRS.  Taxpayers  pay  for  the  service  which  is  often  no  faster  than  filing 
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a  paper  return.  Preparers  must  invest  in  hardware  and  software  and  suffer  reduced 
productivity  while  learning  to  use  the  system.  Comments  such  as  these  from  the  1990 
survey  were  common:  "Program  is  too  costly  and  time  cmisuming  for  preparer,"  and 
"Cost  of  filing  was  too  much  for  clients."  Cost  of  a  modem  and  communications 
software  was  mentioned  repeatedly  as  &  ^asrm  for  filers’  not  filing  directly. 

5.  Timeliness 

Doll  and  Toikzadeh  list  timeliness  as  a  component  which  determines  user 

satisfaction  [Ref.  lS:p.  268].  A  frequently  mentioned  drawback  of  EPS  on  both  1989  and 

1990  surveys  was  that  the  system  was  not  timely  in  providing  refunds.  Slower  refunds 

when  compared  to  paper  returns  and  higher  costs  reduce  the  participation  rate  in  EPS. 

One  1990  survey  respondent  commented,  "All  my  clients  conq>lained  because  their 

refunds  took  many  weeks.  Stopped  using  it— clients  said  they  wouldn’t  use  it  again."  The 

IRS  has  recognized  the  importance  of  timeliness,  as  evidenced  by  the  following  comment 

in  a  briefing  by  the  Assistant  Conunissioner  (Returns  Processing): 

In  the  individual  return  arena, ....speed  is  critically  important  in  meeting  the  needs 
of  the  individual  taxpayer  and  cost  to  accomplish  this  is  less  in^rtant.  The 
Electronic  Piling  Systems  Office  has  attempted  to  maintain  these  objectives  in  its 
development  efforts— maximum  service  to  the  public  at  the  least  cost  to  the 
Government.  [Ref.  20:p.  2] 

The  IRS  appears  to  subscribe  to  the  Theory  W  approach,  but  users  continue  to  observe 
shortcomings. 
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6.  Technical  Quality 

Technical  quality  of  the  system  is  another  success  factor  which  is  mentioned 
often  in  the  literature.  Lucas  states  that,  "...systems  with  high  technical  quality  are 
associated  with  high  levels  of  use  of  information  systems."  [Ref.  6:p.  105]  Technical 
problems  accounted  for  13  percent  of  survey  respondents’  reasons  for  not  filing 
electronically  in  1990  and  for  44  percent  of  respondents  having  problems  with  the  system 
in  1990.  Some  problems  were  minor  while  others  were  more  serious,  such  as  die  1990 
respondent  who  said  he  was  "Unable  to  transmit  because  of  software."  Some  respondents 
suggested  that  the  IRS  offer  software  as  a  means  of  ensuring  better  quality  control.  The 
IRS  has  offered  the  following  response: 

The  two  primary  reasons  the  EPS  Office  has  not  done  this  are  to  avoid  competition 
between  the  government  and  private  industry  in  software  development,  and  the 
government  cannot  be  held  accoimtable  for  erroneous  submissions.  By  not 
becoming  involved  in  actual  return  preparation  software,  the  IRS  can  maintain  its 
proper  autonomy  in  meeting  its  mission  of  Tax  Administration.  [Ref.  20:p.  3] 

7.  User  Friendliness  and  Ease  of  Use 

User  friendliness  and  ease  of  use  are  two  technological  factors  which 
contribute  to  user  satisfaction  [Ref.  4:p.  26].  DoU  and  Torkzadeh  suggest  ease  of  use  as 

r 

one  component  which  determines  user  satisfaction  [Ref.  i5:p.  268].  Rivard  and  Huff 
include  user  friendliness  in  their  list  of  success  factors  for  end-user  computing  [Ref.  16:p. 
558].  Rushinek  and  Rushinek  also  cite  user  friendliness  as  an  important  factor  in  user 
satisfaction  [Ref.  25:p.  594].  Survey  comments  indicated  that  many  preparers  felt  the 
system  was  not  particularly  easy  to  use  or  user  friendly.  One  1990  respondent  summed 
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it  up  this  way,  "Make  program  sin^ler  for  users."  Hie  third  most  often  mentioned 
problem  area  on  the  1990  survey  was  error  codes  (see  Figure  4).  Typical  comments  were, 
"Need  better  error  code  explanations,"  and  "Want  error  codes  more  specific,"  Poor 
quality  manuals  were  another  frequent  complaint.  The  procedure  for  filing  electronically 
requires  that  the  taxpayer’s  W-2  forms  and  a  signature  form  (Form  8453)  be  sent  to  the 
IRS  in  the  traditional  manner,  by  mail.  Preparers’  commented  that  this  procedure  was 
cumbersome. 

8.  Training 

Survey  respondents  indicated  that  they  wanted  more  and  earlier  training  in 
EFS.  Lack  of  training  was  the  fifth  most  firequendy  mentioned  reason  1990  survey 
respondents  gave  for  not  filing  electronically.  Some  of  the  problems  preparers 
experienced  with  manuals  and  error  codes  might  have  been  eliminated  or  reduced  if 
preparers  had  been  thoroughly  trained.  Their  frustration  with  using  the  system  would 
almost  certainly  have  been  lessened  with  training,  and  their  satisfaction  consequendy 
increased. 

F.  FAVORABLE  COMMENTS 

Not  all  the  comments  were  critical  of  EFS,  however.  There  were  almost  half  as 
many  positive  comments  as  there  were  negative  ones  on  the  1990  survey,  most  of  them 
indicating  satisfaction  with  the  system  while  some  were  very  enthusiastic.  Positive 
comments  ranged  from  "Best  the  IRS  has  made  in  years,"  to  "Interesting  program." 
Survey  respondents  were  especially  pleased  with  the  service  provided  by  the  coordinators 
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at  the  Ogden  Service  Center.  A  good  indicator  of  users’  satisfaction  with  the  system  is 
participation.  In  1988,  1.53  percent  of  paid  preparer  refund  returns  in  the  San  Jose 
district  were  filed  electronically;  in  1989,  an  estimated  2.53  percent  were  filed 
electronically;  and,  in  1990,  the  figure  rose  to  5.00  percent  [Ref.  19].  The  participation 
rate  is  showing  a  favorable  trend,  indicating  that  users’  overall  perception  of  EFS  is 
positive. 
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VI.  DISCUSSION  AND  RECOMMENDATIONS 


A.  DISCUSSION  OF  THE  ERROR  RATE 

The  results  of  the  statistical  analysis  of  the  survey  data  do  not  reveal  conclusive 
evidence  to  explain  why  some  filers  have  higher  error  rates  than  others.  It  appears  that 
filers  who  file  more  than  500  returns  electronically  in  a  season  are  likely  to  have  a 
rejection  percentage  below  ten  percent;  however,  many  lower  volume  filers  also  have 
similarly  low  rejection  percentages.  The  choice  of  third  patty  transmitter  may  have  an 
effect  on  the  error  rate— Flashtax,  Lacerte  and  CSC-TACS  users  all  had  higher  rejection 
percentages  than  the  population  while  Compucraft  users  had  a  significantly  lower 
percentage  of  rejections.  Further  research  would  be  necessary  to  determine  whether  there 
is  a  causal  relationship  between  selection  of  transmitter  and  error  rate. 

The  effect  of  method  of  transmission  (direct  or  through  a  third  party)  is  inconclusive 
as  it  may  be  a  result  of  the  larger  volume  of  returns  filed  by  direct  filers  compared  to 
those  who  use  third  party  transmitters.  Neither  length  of  involvement  with  EPS  nor  filing 
in  two  consecutive  years  appears  to  have  a  significant  effect  on  the  error  rate.  Filers 
reporting  problems  with  their  software  did  not  have  a  higher  rejection  percentage  than 
those  who  did  not  report  problems,  so  no  specific  software  packages  can  be  pinpointed 
as  less  effective  in  handling  errors. 

The  San  Jose  District  EFS  Coordinator  conducted  a  telephone  survey  in  1990  of 
filers  with  error  rates  over  10  percent.  The  survey  revealed  that  most  respondents 


47 


attributed  their  high  error  rate  to  either  software  problems  or  human  error.  These 
problems  could  be  symptomatic  of  poor  software  design,  insufficient  testing  of  software, 
poorly  written  manuals,  or  inadequate  training. 

B.  RECOMMENDATIONS  FOR  REDUCING  THE  ERROR  RATE 

The  following  recommendations  are  proposed  to  reduce  the  error  rate  among  filers: 
(1)  more  intensive  training  of  individuals  who  will  be  preparing  electronic  returns  and  (2) 
more  stringent  requirements  and  testing  for  software  developers  prior  to  being  listed  as 
"accepted"  by  the  IRS. 

A  frequently  recurring  comment  among  survey  reqx>ndents  was  that  there  was  a 
need  for  more  training  for  electronic  filers.  More  intensive  training  could  alleviate  the 
human  error  problem  to  some  extent  although  it  can  never  be  entirely  eliminated.  Since 
experience  using  EFS  (filing  more  returns  durmg  the  filing  season)  seems  to  relate  to  a 
lower  rejection  percentage,  training  of  low  volume  filers  might  compensate  for  their  lack 
of  experience. 

More  exhaustive  testing  by  the  IRS  prior  to  listing  software  as  "accepted"  would 
ensure  that  filers  would  use  only  well  designed,  less  trouble  prone  software.  Among  1990 
survey  respondents,  24  reported  dissatisfaction  with  error  codes  provided  by  the  software 
they  used.  Their  comments  indicated  that  the  codes  were  difficult  to  interpret,  and  the 
process  for  correcting  errors  was  not  easy  to  discern.  Poorly  written  manuals  were 
another  frequent  complaint.  If  the  IRS  applied  more  rigorous  standards  in  the  software 
acceptance  process,  with  emphasis  on  ease  of  use  and  error  detection/correction,  then 


48 


errors  could  be  either  avoided  or  detected  and  eliminated  by  the  software  before  returns 
were  transmitted. 

C.  DISCUSSION  OF  THE  PARTICIPATION  RATE 

The  case  study  of  EPS,  with  particular  emphasis  on  the  partic4>ation  rate,  revealed 
that  users  were,  in  general,  pleased  with  the  concept  of  EPS  and  its  potential  for  speeding 
the  processing  of  tax  returns.  The  participation  rate  in  the  San  Jose  district  has  increased 
each  year  since  the  system  was  introduced. 

The  different  categories  of  users  of  EPS  make  its  successful  implementation  a 
complex  process.  Taxpayers  want  prompt  refunds  for  the  least  cost;  tax  preparers  want 
fast,  efficient  processing  of  returns  which  generates  a  profit;  the  IRS  wants  cost 
economies.  The  emphasis  in  design  and  implementation  of  EPS  iq>pears,  from  the 
taxpayers’  and  preparers’  points  of  view,  to  be  on  a  system  which  meets  the  IRS’s  needs, 
and  falls  short  of  meeting  taxpayers’  and  preparers’  needs.  Participation  in  EPS  is, 
therefore,  not  as  high  as  it  could  be. 

The  study  considered  factors  which  influence  the  participation  rate  and  determined 
the  factors  which  had  the  most  significant  impact.  These  factors  were  planning,  user 
participation,  user  attitude,  cost,  timeliness,  technical  quality,  user  friendliness  and  ease 
of  use,  and  training. 

D.  RECOMMENDATIONS  FOR  INCREASING  THE  PARTICIPATION  RATE 
The  success  factors  form  the  basis  for  recommendations  for  increasing  the 

participation  rate  in  the  San  Jose  district.  The  recommendations  can  be  generalized  to 
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q>ply  to  all  IRS  districts.  The  following  recommendations  are  proposed: 

1.  Solicit,  consider,  and  act  upon  suggestions  and  comments  from  taxpayers  and  tax 
preparers. 

2.  &isure  that  EPS  delivers  refunds  faster  tfian  traditional  filing  methods  and  within 
the  time  period  advertised. 

3.  Rigorously  test  software  before  listing  it  as  "accepted". 

4.  Develop  an  effective  training  program  for  preparers  and  offer  it  early  enough  to 
permit  preparers  to  have  completed  it  before  the  start  of  the  filing  season. 

As  the  responses  to  the  two  surveys  demonstrate,  tax  preparers  appear  eager  to  offer 
suggestions  for  improving  EPS.  If  the  IRS  were  to  permit  active  participation  of  users 
in  determining  improvements  to  the  system,  then  overall  participation  in  EPS  would  be 
likely  to  increase.  Specific  recommendations  which  survey  respondents  made  which 
rq^pear  to  merit  consideration  are: 

1.  Permit  users  to  transmit  with  modems  of  less  than  4800  baud  rate. 

2.  Allow  taxpayers  to  deduct  from  their  taxes,  or  at  least  partially  refund,  the 
electronic  filing  fee. 

Timeliness  of  refunds  is  important  to  the  taxpayers  and  is  the  major  advantage  EPS 
offers  them  over  filing  paper  returns.  If  the  system  is  no  faster,  or  if  it  fails  to  live  up 

r 

to  its  promises,  then  taxpayers  will  not  use  it  and  partici^u.ion  will  not  increase. 

More  rigorous  testing  of  software  would  eliminate  many  of  the  problems  preparers 
experienced  in  using,  or  attempting  to  use,  EPS.  More  preparers  would  probably  be 
interested  in  using  the  system  and  in  encouraging  taxpayers  to  use  it,  if  it  were  easier  to 
use.  Better  quality  software  would  also  reduce  the  cost  to  preparers  by  allowing  them  to 
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devote  more  of  their  time  to  preparation  of  tax  returns  rather  than  to  attempting  to  resolve 
problems  with  the  software  or  to  correcting  and  resubmitting  rejected  returns. 

Training  was  mentioned  often  by  survey  respondents  as  an  area  which  could  be 
improved.  The  comments  on  training  indicated  that  preparers  would  like  to  see  more 
training  offered  and  that  the  timing  of  the  training  was  important.  Training  would  be 
most  beneficial  before  the  start  of  the  filing  season  so  that  preparers  are  familiar  with  the 
system  and  can  handle  clients’  requests  for  electronic  filing  efficiently  once  the  filing 
season  begins. 

E.  LESSONS  LEARNED  FOR  SUCCESSFUL  IMPLEMENTATION 

Many  lessons  can  be  learned  from  the  implementation  of  EFS.  One  of  the  most 
important  is  that,  when  implementing  a  large  scale  computer  system,  consideration  must 
be  given  to  the  needs  of  all  users  or  stakeholders.  The  best  way  to  determine  these  needs 
is  to  allow  each  group  of  users  to  participate  in  the  design  and  implementation  of  the 
system.  It  is  not  possible  to  satisfy  all  needs  of  all  groups  of  users— at  times  they  conflict 
and  a  compromise  or  decision  in  favor  of  one  group  must  be  made.  An  effort  should  be 
made  to  consider  each  group  and  balance  their  respective  needs  and  desires.  Each  group 
of  users  must  perceive  some  advantage  to  using  the  system  or  they  will  not  participate. 

Quality  control  of  software  can  have  significant  results.  If  it  is  effective,  it  can 
encourage  increased  participation  and  decrease  errors  in  using  the  system.  If  it  is 
ineffective,  users  will  be  discouraged  from  using  the  system  because  of  the  problems  they 
encounter  with  the  software. 
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From  a  marketing  point  of  view,  it  is  important  to  promise  no  more  than  can  be 
delivered;  otherwise,  users  may  become  fmstrated  and  stop  using  the  system.  Potential 
new  users  will  be  less  inclined  to  use  the  system  if  it  has  a  reputation  for  failing  to 
produce  as  expected. 

The  implementor  of  a  large  scale  computer  must  at  all  times  be  cognizant  of  the 
needs  of  all  the  system’s  users  and  must  strive  to  meet  as  many  of  these  needs  as 
possible.  The  IRS  is  making  progress— particq>ation  in  EFS  continues  to  increase  and  the 
error  rate  remains  significantly  below  that  for  paper  returns. 
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APPENDIX  A 


GLOSSARY  OF  TERMS  AND  ACRONYMS 


Teim/Acronvm 
direct  filer 

DIS 

EF 

EFIN 

EFS 

electronic  return  collector 

filer 

filing  season 

IRS 

IS 

MIS 


Meaning 

Filer  who  files  returns 
electronically  using  his  own 
modent/equipment. 

Distributed  Input  System 

Electronic  Filing 

Electronic  Filing  Identification 
Number 

Electronic  Filing  System 

Individual  or  firm  which  accepts 
prepared  returns  directly  from 
taxpayers  from  which  it  produces 
electronic  returns. 

Individual  or  firm  that  files  returns 
electronically. 

Period  during  which  tax  returns  are 
filed.  Normally  January  to  April  15 
of  the  year  following  the  applicable 
tax  year. 

Internal  Revenue  Service 
Information  System 
Management  Information  System 
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preparer 


preparerAransmitter 


service  bureau 


tax  practitioner 


tax  year 

third  party  transmitter 


transmitter 


Individual  or  firm  which  fills  in 
an  electronic  return  and  computes  die 
tax  based  on  information  the  taxpayer 
provides. 

Individual  or  firm  which  performs  the 
same  role  as  a  prqiaier  and  also 
transmits  returns  directly  to  IRS. 

Tax  return  processor  who  provides  a 
variety  of  services  to  tax  preparers, 
including  collection  or  transmittal 
of  returns  to  the  IRS. 

Individual  or  firm  which  prepares  or 
transmits  electronic  returns  to  the 
IRS. 

Calendar  year  for  which  tax  is 
paid/withheld. 

Service  bureau  or  other  organization 
which  transmits  prepared  returns 
electronically  for  tax  preparers  who 
are  not  equipped  to  file  directly. 

Individual  or  firm  which  transmits 
returns  directly  to  the  IRS. 
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APPENDK  B 


SURVEY  QUESTIONNAIRES  AND  IRS  SUMMARY  REPORTS 

I.  SURVEY  QUESTIONNAIRES 
A.  1989  SURVEY 


I  I 

PLKASK  HBLP  OS  TO  HKLP  TOO! 

You  are  part  of  a  group  of  tax  practitioners  who  applied 
to  participate  in  electronic  filing.  Although  we  may 
have  talked  by  phone,  please  take  a  moment  to  provide 
the  electronic  filing  program  with  valuable  feedback. 
Please  let  us  know  problems  experienced  and  how  we  can 
better  serve  you.  We  especially  want  to  hear  from 
those  who  applied  but  did  not  file  returns  this  past 
filing  season  under  your  own  EFIN.  You  can  fold  this 
note,  staple  it,  and  mail  back  to  us,  postage  paid. 


MARK  RACK  BOX  THAT  APPLZBS: 


□ 

□ 

□ 

□ 


I  applied  but  did  not  file  electronically. 

My  clients  filed  their  returns  electronically 

through  _ 

I  applied  to  keep  informed  of  new  technology. 

Other 


I  had  trouble  with  my 


□ 

□ 

□ 

□ 

□ 


hardware 

modem 

software  (which  was 
transmitter  (who  was 


other 


□  □□  □□□  □□□□ 


My  software  vendor  _  (name) 

did  not  pass  PATS  testing 
did  not  complete  PATS  timely 

other  _ 

My  transmitter  _  (name) 

did  not  pass  PATS  testing 
did  not  complete  PATS  timely 

other  _ 

I  couldn't  justify  the  expense 

of  the  software 
of  the  hardware 

of  the  additional  labor/overhead 
other  _ 

^  I  would  like  to  participate  next  year.  I  would 
like  to  see  the  following  changes: 


□ 


□ 


How  can  we  better  serve  you? 


Other  problems  experienced. 


B.  1990  SURVEY 


H«lp  U«  B«lp  You! 

Please  take  a  few  minutes  to  fill  out  this  Electronic 
Filing  Questionnaire.  He  are  seeking  your  feedback  on 
the  1990  Electronic  Filing  Season.  He  want  your  candid 
comments,  pro  and  con.  This  is  your  opportunity  to  let 
us  know  your  ideas  on  how  we  might  improve  the  system. 
Once  the  questionnaire  is  completed,  please  fold,  staple 
and  mail  back  to  us... postage  paid.  He  appreciate  your 
comments . . . 

PLEASE  MARK  EACH  BOX  THAT  APPLIES 


□ 


□ 

□ 


1  transmitted  directly  to  the  IRS 

used  4800  _  or  9600  _  Baud  Modem 

Name  of  Modem  _ 

I  recommend  Yes  _  No  _ 

Comments  _ 

I  transmitted  through  Third  Party, 

Name  of  Transmitter  _ 

I  recommend  Yes  _  No  _ 

I  was  accepted  for  EF  but  did  not  file 

Electronically  because  _ 


□ 

□ 

□ 

□ 


I  had  trouble /problem  with: 

Software.  Name  _ 

Getting  Software  Manual  _ 

Third  Party  Transmitter.  Name 
Getting  Acknowledgement  File  _ 


□  □  □  □ 


I  had  trouble/problem  with: 

Understanding  Error  Codes  _ 

Purchasing  Equipment  _ 

Cost  of  Equipment  _ 

Routing  Transit  numbers  and  account  numbers  of 
Credit  Unions/Banks.  Names  _ 


Direct  Deposit  _ 

Proof  of  Direct  Deposit 
Ogden  Service  Center  _ 


Other 


Feedback:  Positive  and  Negative 


Changes  you  want  to  see  in  the  program 


How  can  the  Electronic  Filing  Coordinator  better 
serve  you  _ 
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n.  IRS  SURVEY  SUMMARY  REPORTS 


A.  1989  SUMMARY  REPORT 


BREAKDOWN  OF  RESPONSES  TOTAL 

DID  ELECTRONICALLY  FILE . :  61 

DID  NOT  ELECTRONICALLY  FILE . :  165 

APPLIED  TO  KEEP  INFORMED . :  33 

OTHER . :  8 


TROUBLE 

HARDWARE . :  6 

SOFTWARE . :  34 

MODEM . :  9 

TRANSMITTER . :  68 

REFUND  TOO  SLOW . :  19 

PROGRAM  TOO  COMPLICATED . :  6 

NEED  BETTER  ADVERTISING . :  12 

NOT  ENOUGH  CLIENT  INTEREST . :  28 

OTHER . :  3 


PREPARER  ACCEPTANCE  TESTING  SYSTEM 

SOFTWARE  VENDOR . :  58 

SOFTWARE  -  NOT  PASS . :  2 

SOFTWARE  -  NOT  COMPLETE . :  2 

TRANSMITTER  VENDOR . ;  51 

TRANSMITTER  -  NOT  PASS . :  0 

TRANSMITTER  -  NOT  COMPLETE . :  3 

OTHER . :  8 


TOO  EXPENSIVE  ! ! ! ! 

SOFTWARE . ;  42 

HARDWARE . ;  25 

LABOR/OVERHEAD . :  35 

OTHER . :  19 


WILL  YOU  PARTICIPATE  NEXT  YEAR?  YES  -  190 

NO  -  3 

TOTAL  NUMBER  OF  RESPONSES  TO  THE  450  QUESTIONNAIRES  SENT 
IS:  234 
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B.  1990  SUMMARY  REPORT 


TOTAL 

BREAKDOWN  OF  RESPONSES 

DIRECT  TRANSMITTER . :  28 

4800  ^«)DEM . :  28 

9600  MODEM . :  0 

RECOMMENDED . :  26 


TRANSMITTED  THROUGH  THIRD  PARTY....:  179 

RECOIMENDED . :  7 


ACCEPTED/NOT  FILED . :  178 


TROUBLE 

SOFTWARE . :  53 

GETTING  MANUAL . :  7 

3RD  PARTY . :  20 

ACKNOWLEDGEMENT . :  11 

ERROR  CODES . :  18 

PURCHASING  EQUIPMENT . :  17 

COST  OF  EQUIPMENT . :  7 

RTN . :  16 

DIRECT  DEPOSIT . :  7 

PROOF  OF  DIRECT  DEPOSIT . :  8 

OGDEN . :  4 

OTHER . :  71 


TOTAL  NUMBER  OF  RESPONSES  TO  THE  650  QUESTIONNAIRES  SENT 
IS:  373 
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APPENDIX  C 


STATISTICAL  ANALYSIS 

I.  DESCRIPTION 

A.  Computer  Package  and  Tests 

A  statistical  analysis  of  the  data  provided  by  the  IRS  was  performed  using 
the  statistical  computer  package  Minitab.  Two  different  hypothesis  tests  were  used  as 
required.  The  Minitab  ZTEST  was  used  to  compare  a  sample  mean  to  the  population 
mean  when  the  sample  was  large  (n  >=  30)  or  the  standard  deviation  of  the  population 
was  known.  The  Minitab  TWOSAMPLE  T  test  was  used  to  compare  the  means  of  two 
small  (n  <  30),  independent  samples  whose  population  standard  deviations  were  unknown 
but  not  assumed  equal.  A  detailed  description  of  the  results  of  the  tests  follows.  Unless 
otherwise  specified,  "population"  refers  to  the  population  of  rejection  percentages  for  all 
1990  electronic  filers  which  was  provided  by  the  San  Jose  District  of  the  IRS. 

B.  Column  Descriptions 

The  data  were  entered  into  Mmitab  in  columns  as  follows: 

Column  Column  Column 

No.  Name  Description 

Cl  EFIN  Electronic  Filing  Identification 

Number  (last  three  digits). 
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C2  RETURNS 

C3  REFUND 

C4  REJECr% 

C5  RESIDUAL 

C6  FLASHTXS 

C7  LACERTES 

C8  COMPUCFT 

C9  CSC-TACS 

CIO  LACERTET 

Cll  FLASHTXT 

C12  3RDPRTY% 


Number  of  returns  filed  elec¬ 
tronically  during  the  1990 
niing  season. 

Total  amount  of  refunds  for 
EF  returns  in  1990. 

Percentage  of  electronically 
filed  returns  rejected  in  19%. 

The  residuals  from  the  regression 
analysis. 

Rejection  percentages  for  1990 
survey  respondents  reporting 
problems  with  Flashtax  software. 

Rejection  percentages  for  1990 
survey  respondents  reporting 
problems  with  Lacerte  software. 

Rejection  percentages  for  1990 
survey  respondents  using 
Compucrafi  transmitter. 

Rejection  percentages  for  1990 
survey  respondents  using 
CSC-TACS  transmitter. 

Rejection  percentages  for  1990 
survey  respondents  using 
Lacerte  transmitter. 

r 

Rejection  percentages  for  1990 
survey  respondents  using 
Flashtax  transmitter. 

Rejection  percentages  for  1990 
survey  respondents  who  used  third 
party  transmitters. 


C13  DIRECr%  Rejection  percentages  for  1990 

survey  respondents  who  filed 
directly. 

C14  FILE2  Rejection  percentages  for  filers 

who  responded  to  both  1989  and 
1990  surveys  and  filed  electron¬ 
ically  in  both  years. 


C15  DRETURNS  Number  of  returns  filed  directly 

by  1990  survey  respondents. 

C16  3RETURNS  Number  of  returns  filed  through 

third  party  transmitters  by  19W 
survey  respondents. 


n.  REGRESSION  ANALYSIS 

Printout  1  displays  the  results  of  the  calculation  of  the  linear  correlation 
coefficient  for  each  pair  of  the  variables  being  considered.  The  variables  RETURNS  and 
REFUND  have  a  correlation  coefficient  of  0.936,  indicating  that  they  are  highly  correlated 
with  each  other.  In  order  to  avoid  any  corruption  of  the  results  of  the  regression  analysis 
by  multicoUinearity  of  variables,  either  RETURNS  or  REFUND  had  to  be  dropped  from 
consideration.  Since  refunds  are  more  realistically  dependent  on  number  of  returns 
submitted  than  the  reverse,  the  decision  was  made  to  use  the  RETURNS  data. 
Consequently,  REFUND  was  not  considered  as  a  variable  when  performing  the  regression 
analysis. 


MTB  >  CORK  C1-C4 

RETURNS 

EFIN 

0.014 

RETURNS 

REFUND 

REFUND 

0.009 

0.936 

REJECT% 

0.138 

-0.128 

-0.137 

Printout  1.  Linear  Correlation  Coefficients. 
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Printout  2  is  the  regression  analysis  of  the  data  with  REJECT%  as  the  dqrendent 


variable  and  EFIN  and  RETURNS  as  the  independent  variables.  The  results  show  that 


very  little  of  the  variation  in  the  percentage  of  rejections  can  be  accounted  for  by  the  two 


independent  variables.  Printout  3  is  a  graph  of  the  residuals,  indicating  a  strong  positive 


linear  correlation.  Printout  4  shows  the  correlation  between  residuals  and  REJECT%. 


MTB  >  REGRESS  C4  2  Cl  C2; 

SUBO  RESIDUALS  C5 . 

The  regression  equation  is 

REJECT%  -  7.98  +  0.0113  EFIN  -  0.00381  RETURNS 


Predictor 

Coef 

Stdev  t-ratio 

P 

Constant 

7.979 

2.204  3.62 

0.000 

EFIN 

0.011259 

0.005382  2.09 

0.038 

RETURNS 

-0.003806 

0.001947  -1.96 

0.052 

s  -  17.51 

R-sq 

=3.6%  R-sq (ad j)  - 

2.7% 

Analysis  of 
SOURCE 

Variance 

DF 

SS  MS 

F 

Regression 

2 

2478.6  1239.3 

4.04 

Error 

217 

66540.3  306.6 

Total 

219 

69018.9 

SOURCE 

DF 

SEQ  SS 

EFIN 

1 

1306.5 

RETURNS 

1 

1172.1 

Unusual  Observations 


Obs . 

EFIN 

REJECT% 

Fit 

Stdev. Fit 

Residual 

St. Resid 

31 

60 

50.00 

8.65 

1.94 

41.35 

2.38R 

35 

71 

50.00 

8.77 

1.90 

41.23 

2.37R 

82 

227 

66.60 

10.52 

1.37 

56.08 

3,21R 

101 

315 

0.80 

4.21 

3.60 

-3.41 

-0.20  X 

124 

401 

50.00 

12.49 

1.27 

37.51 

2,15R 

127 

423 

100.00 

12.74 

1.31 

87.26 

5.00R 

130 

434 

0.00 

-4.56 

8.65 

4.56 

0.30  X 

131 

435 

0.00 

2.49 

5.12 

-2.49 

-0.15  X 

132 

436 

0.10 

-2.24 

7.49 

2.34 

0.15  X 

134 

438 

0.10 

3.12 

4.82 

-3.02 

-0.18  X 

137 

441 

0.10 

-3.70 

8.26 

3.80 

0.25  X 

149 

474 

52.90 

13.25 

1.42 

39.65 

2.27R 

172 

549 

52.80 

13.82 

1.64 

38.98 

2.24R 

174 

555 

100.00 

14.22 

1.69 

85,78 

4.92R 

178 

571 

62.50 

14.38 

1.75 

48.12 

2.76R 

184 

591 

50.00 

14.62 

1.83 

35.38 

2.03R 

197 

630 

100.00 

15.06 

1.99 

84.94 

4.88R 

219 

723 

57.10 

16.09 

2.40 

41.01 

2.36R 

R  denotes  an  obs.  with  a  large  st.  resid. 

X  denotes  an  obs.  whose  X  value  gives  it  large  influence. 

Printout  2.  Regression  Analysis. 
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MTB  >  PLOT  C5  C4 
RESIDUAL- 

3 


70+ 


* 


22  * 

35+  4 

_  *  *  -> 

2  24 

_  *  **7* 

-  2  3653*6** 

0+  4*  654542 

-  +6664* 

_  +** 


+ - + - + - + - + - REJECT% 

0  20  40  60  80  100 


Printout  3.  Plot  of  Residuals  of  Regression  Analysb. 


MTB  >  CORK  C5  C4 

Correlation  of  RESIDOAL  and  RBJECT%  -  0.982 

Printout  4.  Correlation  Between  Residuals  and  Rejection 
Percentage. 


in.  GRAPHS  OF  RELATIONSHIPS  OF  EFIN  TO  REJECTION  PERCENTAGE 

AND  NUMBER  OF  RETURNS  SUBMITTED  TO  REJECT  PERCENTAGE 
Printout  5  gr^^hs  the  relationship  between  EFIN  and  rejection  percentage.  As 
could  be  expected  from  the  regression  analysis  (see  Printout  2)  and  the  correlation 
coefficient  for  the  two  variables  (0.138),  there  appears  to  be  little  correlation  between 
EFIN  and  rejection  percentage. 
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MTB  >  PLOT 

C4 

Cl 

105+ 

- 

*  *  * 

REJECT%  - 

70+ 

it 

- 

* 

*  * 

* 

- 

itit 

*  * 

** 

it  it 

* 

35+ 

* 

it  * 

*  **  * 

* 

- 

* 

*  * 

2  **  *  ifif 

* 

- 

* 

*  *  * 

**  2  23  * 

- 

3* 

3  ***  2*  * 

*  itH  it  it  it  2 

2 

- 

22 

*2***2**3*  * 

*  2  ****  4* 

* 

0+ 

**63433*42*2*3  * 

22322423*25*  92522**2*2  246 

3**3* 

+ — 

- + - 

- + - + - + - 

- EFIN 

0 

150 

300  450  600 

750 

Printout  5.  Plot  of  Rejection  Percentage  as  a  Function  of  EFIN. 


Printout  6  plots  the  relationship  between  number  of  returns  submitted  and  the 
rejection  percentage.  The  correlation  coefticient  of  these  two  variables  is  -0.128,  which 
indicates  there  is  little  linear  correlation  between  the  two.  However,  the  plot  appears  to 
approximate  a  curve  which  strongly  indicates  that  the  percentage  of  rejections  drops  off 
sharply  as  the  number  of  returns  submitted  approaches  500.  Beyond  500  (approximately) 
REJECT%  continues  to  drop,  but  more  slowly,  ^>proaching  zero  as  RETURNS  increases. 
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MTB  >  PLOT 

C4  C2 

105+ 

- 

3 

REJECT%  - 

70+ 

* 

- 

ft 

- 

2* 

- 

6 

- 

2* 

35+ 

53 

- 

92 

- 

93*  * 

- 

9+42 

- 

++**2**  * 

0+ 

+433**  *  ***  2 

* 

*  * 

+ - + - + - 

- + - 

- +— 

- RETURNS 

0  1000  2000 

3000 

4000 

5000 

Printout  6.  Plot  of  Rejection  Percentage  as  a  Function 
of  Number  of  Returns  Submitted. 


IV.  POPULATION  DISTRIBUTION 

Printout  7  is  a  histogram  showing  the  distribution  of  the  population  of  rejection 
percentages,  including  the  population  mean  and  standard  deviation.  Some  of  the 
statistical  tests  which  follow  assume  that  the  population  is  approximately  normally 
distributed.  As  it  does  not  appear  to  be  a  normal  distribution,  the  results  of  some  of  the 
tests  may  not  be  conclusive. 
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MTB  >  HISTOGRAM  C4; 
SUBO  INCR-S. 


Histogram  of  REJECT%  N  —  220 
Each  *  represents  5  obs. 


Midpoint 

Count 

0.00 

109 

5.00 

24 

***** 

10.00 

17 

**** 

15.00 

20 

**** 

20.00 

12 

*** 

25.00 

11 

*** 

30.00 

2 

* 

35.00 

8 

** 

40.00 

3 

* 

45.00 

0 

50.00 

6 

** 

55.00 

3 

* 

60.00 

0 

65.00 

2 

* 

70.00 

0 

75.00 

0 

80.00 

0 

85.00 

0 

90.00 

0 

95.00 

0 

100.00 

3 

* 

MTB  >  STDEV  C4 

ST. DEV. 

= 

17.753 

MTB  >  MEAN 

C4 

MEAN 

11.123 

Printout  7.  Histogram  of  Rejection  Percentages. 


V.  COMPARISON  OF  DIRECT  FILERS  AND  »  LERS  USING  THIRD 
PARTY  TRANSMITTERS 

Printout  8  is  a  right-tailed  hypothesis  test  which  compares  the  mean  of  the 
rejection  percentages  for  all  1990  survey  respondents  who  used  third  party  transmitters 
to  transmit  their  returns  (3RDPRTY%,  column  Cl 2)  to  the  population  mean  to  determine 
if  the  sample  mean  is  greater  than  the  population  mean  at  a  5%  significance  level.  (The 
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Minitab  ZTEST  was  used  because  it  is  appropriate  for  a  sample  with  known  standard 
deviation.  The  test  assumes  a  normally  distributed  population.  The  population  used  in 
this  analysis  does  not  appear  to  be  normal  (see  Printout  7)  so  the  results  may  not  be 
conclusive.)  The  results  indicate  that  the  data  do  not  provide  sufficient  evidence  to 
conclude  that  filers  who  filed  through  a  third  party  had  a  higher  percentage  of  rejections 
than  the  population  as  a  whole. 


MTB  >  ZTEST  11.123  17.753 
SUBO  ALTE=1. 

C12; 

TEST  OF  MU  =  11.123  VS  MU 
THE  ASSUMED  SIGMA  -  17.8 

G.T.  11.123 

N  MEAN 

STDEV  SE  MEAN 

Z 

P  VALUE 

3RDPRTY%  84  13.249 

18.339  1.937 

1.10 

0.14 

Printout  8.  Hypothesis  Test  of  Mean  Rejection  Percentages  for 
Filers  Using  Third  Party  Transmitters  and  Population. 


Printout  9  is  a  left-tailed  hypothesis  test  which  compares  the  mean  of  rejection 
percentages  for  all  1990  survey  respondents  who  filed  directly  without  using  a  third  party 
(DIRECr%,  column  Cl 3)  to  the  population  mean  to  determine  if  the  sample  mean  is  less 
than  the  population  mean  at  a  5%  significance  level.  (The  Minitab  ZTEST  was  used 
because  it  is  appropriate  for  a  sample  with  known  standard  deviation.  The  test  assumes 
a  normally  distributed  population.  The  population  used  in  this  analysis  does  not  appear 
to  be  normal  (see  Printout  7)  so  the  results  may  not  be  conclusive.)  The  results  indicate 
that  the  data  do  not  provide  sufficient  evidence  to  conclude  that  the  filers  who  filed 
directly  had  a  lower  percentage  of  rejections  than  the  population  as  a  whole. 
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MTB  >  ZTEST  11.123  17.753 
SUBO  ALTE— 1. 

C13; 

TEST  OF  MU  -  11.123  VS  MU 
THE  ASSUMED  SIGMA  -  17.8 

L.T.  11.123 

N  MEAN 

STOEV  SE  MEAN 

Z 

P  VALUE 

DIRECT%  16  9.456 

7.173  4.438 

1 

o 

00 

0.35 

Printout  9.  Hypothesis  Test  of  Mean  Rejection  Percentages  for 
Direct  Filers  and  Population. 


Printout  10  is  a  right-tailed  hypothesis  test  to  determine  whether  filers  using  third 
party  transmitters  have  a  higher  percentage  of  rejections  than  direct  filers.  (While  the 
data  in  column  C12  (3RDPRTY%)  represent  a  large  sample  (n  >  30),  there  are  only  16 
elements  in  Cl 3  (DIRECr%),  so  it  must  be  considered  a  small  sample.  Therefore,  the 
Minitab  TWOSAMPLE  T  test  was  chosen  to  perform  the  test  because  it  applies  to 
hypothesis  tests  for  two  means  for  normal  populations;  smalljlndependent  samples;  and 
population  standard  deviations  unknown  and  assumed  unequal.  The  populations  for  this 
test,  all  direct  filers  and  all  filers  who  used  third  party  transmitters,  are  assumed  to  be 
normal.)  The  results  indicate  that  at  the  5%  significance  level  the  data  do  not  provide 
sufficient  evidence  to  conclude  that  direct  filers  have  a  lower  percentage  of  rejections  than 
filers  who  use  tliird  party  transmitters.  However,  at  the  10%  significance  level,  there  is 
evidence  to  conclude  that  direct  filers  do  have  a  lower  percentage  of  rejections  than  filers 
who  use  third  party  transmitters. 
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MTB  >  TWOSAMPLE  T  C12  C13; 

SUBO  ALTE-1. 

TWOSAMPLE  T  FOR  3RDPRTy%  VS  DIRECT% 

N  MEAN  STDEV  SE  MEAN 

3RDPRTV%  84  13.2  18.3  2.0 

D1RECT%  16  9.46  7.17  1.8 

95  PCT  Cl  FOR  MU  3RDPRTY%  -  MU  DIRECT%:  (-1.6,  9.2) 

TTEST  MU  3RDPRTY%  -  MU  DIRECT%  (VS  GT) :  T-  1.41  P-0.082  DF-59 


Printout  10.  Hypothesis  Test  to  Compare  Mean  Rejection  Percentages 
of  Filers  Using  Third  Party  Transmitters  and  Direct  Filers. 


Further  tests  were  performed  to  determine  whether  the  number  of  returns  filed  by 
each  type  of  filer  (direct  or  through  third  party  transmitter),  rather  than  the  method  of 
filing,  might  have  influenced  the  rejection  percentage.  Printout  1 1  is  a  hypothesis  test  of 
the  means  of  the  two  samples  to  determine  whether  direct  filers  file  more  returns  than 
those  who  use  third  party  transmitters.  (The  Minitab  TWOSAMPLE  T  test  was  used 
because  it  is  appropriate  for  small  (nQKETURNs  independent  samples  whose 

population  standard  deviations  are  unknown  but  not  assumed  equal.  The  populations  for 
this  test,  all  direct  filers  and  all  filers  who  used  third  party  transmitters,  are  assumed  to 
be  nonnally  distributed.)  The  results  indicate  that,  at  the  5%  significance  level,  direct 
fders  file  more  returns  than  third  party  transmitters.  The  difference  in  rejection 
percentages  between  direct  filers  and  those  using  third  party  transmitters  may,  therefore, 
be  due  to  the  volume  of  returns  filed  rather  than  the  method  of  transmission. 
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MTB  >  TWOSAMPLE  T  C15  C16; 

SUBO  ALTE-1. 

TWOSAMPLE  T  FOR  DRETURNS  VS  3RETURNS 

N  MEAN  STDEV  SE  MEAN 

DRETURNS  16  273  352  88 

3RETURNS  84  56  213  23 

95  PCT  Cl  FOR  MU  DRETURNS  -  MU  3RETURNS:  (25,  408) 

TTEST  MU  DRETURNS  -  MU  3RETURNS  (VS  GT) :  T-2,38  P-0,015  DF-17 


Printout  11.  Hypothesis  Test  to  Compare  Mean  Number  of  Returns  of 
Direct  Filers  and  Third  Party  Users. 


VI.  COMPARISON  OF  NEW  FILERS  WITH  SECOND  YEAR  FILERS 

Printout  12  is  a  hypothesis  test  which  compares  the  mean  of  rejection  percentages 
for  each  filer  who  responded  to  both  1989  and  1990  surveys  and  who  filed  returns 
electronically  in  both  1989  and  1990  filing  seasons  to  the  population  mean  to  determine 
if  the  sample  mean  is  less  than  the  population  mean  at  a  5%  significance  level.  (The 
Minitab  Z'I'EST  was  used  because  it  is  appropriate  for  a  sample  with  known  standard 
deviation.  The  test  assumes  a  normally  distributed  population.  The  population  used  in 
this  analysis  does  not  appear  to  be  normal  (see  Printout  7)  so  the  results  may  not  be 
conclusive.)  The  results  indicate  that  the  data  do  not  provide  sufficient  evidence  to 
conclude  that  the  filers  who  filed  in  both  1989  and  1990  had  a  lower  percentage  of 
rejections  than  the  population  as  a  whole. 
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MTB  >  ZTEST  11.123  17.753 
SUBO  ALTE— 1. 

C14; 

TEST  or  MU  -  11.123  VS  MU 
THE  ASSUMED  SIGMA  -  17.8 

L.T.  11.123 

N  MEAN 

STDEV  SE  MEAN 

Z 

P  VALUE 

F1LE2  22  8.191 

9.674  3.785 

-0.77 

0.22 

Printout  12.  Hypothesis  Test  of  Sample  Mean  and  Population  Mean. 


Vn.  COMPARISON  OF  REJECTION  PERCENTAGES  FOR  SOFTWARE 

The  rejection  percentages  for  1990  survey  respondents  who  reported  problems 
with  software  were  analyzed  to  determine  whether  they  had  higher  rejection  percentages 
than  the  population.  Only  software  reported  by  five  or  more  respondents  was  considered. 

Printout  13  is  a  hypothesis  test  of  the  mean  of  the  rejection  percentages  for  1990 
survey  respondents  who  repotted  problems  using  the  Flashtax  software  .  (The  Minitab 
ZTEST  was  used  because  it  is  appropriate  for  a  sample  with  known  standard  deviation. 
The  test  assumes  a  normally  distributed  population.  The  population  used  in  this  analysis 
does  not  appear  to  be  normal  (see  Printout  7)  so  the  results  may  not  be  conclusive.)  At 
the  5%  significance  level  the  data  do  not  provide  sufficient  evidence  to  conclude  that 
Flashtax  software  users  have  a  higher  rejection  percentage  than  the  population  as  a  whole. 

Printout  14  reports  the  sample  mean  of  the  rejection  percentages  for  1990  survey 
respondents  who  reported  problems  using  the  Lacerte  software.  The  sample  mean 
(9.7267)  is  less  than  the  population  mean  (11.123). 
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MTB  >  ZTEST  11.123  17.753  C6; 
SUBO  ALTE-1. 


TEST  OF  MU  -  11.123  VS  MU  G.T.  11.123 
THE  ASSUMED  SIGMA  -17.8 

N  MEAN  STDEV  SE  MEAN  Z  P  VALUE 

FLASHTXS  5  15.640  6.289  7.939  0.57  0.28 


Printout  13.  Hypothesis  Test  of  Sample  Mean  and  Population  Mean. 


MTB  >  MEAN  C7 

MEAN 

9.7267 

Printout  14.  Mean  of  Rejection  Percentages 
for  1990  Survey  Respondents 
Reporting  Problems  with 
Lacerte  Software. 


Vin.  COMPARISON  OF  REJFXTION  PERCENTAGES  FOR  TRANSMITTERS 
The  rejection  percentages  for  1990  survey  respondents  who  used  third  party 
transmitters  were  analyzed  to  determine  whether  the  transmitter  affected  the  rejection 
percentage.  Four  were  considered,  each  having  five  or  more  users:  Compucraft  (Printout 
15),  CSC-TACS  (Printout  16),  Lacerte  (Printout  17),  and  Flashtax  (Printout  18).  A 

r 

hypothesis  test  was  performed  in  each  case  to  con^iue  the  sample  mean  with  the 
population  mean.  (The  Minitab  27rEST  was  used  because  it  is  appropriate  for  a  sample 
with  known  standard  deviation.  The  test  assumes  a  normally  distributed  population.)  At 
the  5%  significance  level  only  Flashtax  had  a  higher  rejection  percentage  than  the 
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population.  At  the  10%  signiticance  level,  however,  Lacerte  and  CSC-TACS  were  also 
higher,  while  Compucraft  was  lower. 


MTB  >  ZTEST  11.123  17.753 

C8; 

SUBO  ALTE— 1. 

TEST  OF  MU  -  11.123  VS  MU 
THE  ASSUMED  SIGMA  -  17.8 

L.T.  11.123 

N  MEAN 

STDEV  SE  MEAN 

Z 

P  VALUE 

CCMPUCFT  19  5.042 

11.103  4.073 

-1.49 

0.068 

Printout  15.  Hypothesis  Test  for  1990  Survey  Respondents  Using 
Compucraft  Transmitter. 


MTB  >  ZTEST  11.123  17.753 
SUBO  ALTE-1. 

C9; 

TEST  OF  MU  -  11.123  VS  MU 
THE  ASSUMED  SIGMA  =17.8 

G.T.  11.123 

N  MEAN 

STDEV  SE  MEAN 

Z 

P  VALUE 

CSC-TACS  5  21.360 

21.679  7.939 

1.29 

0.099 

Printout  16.  Hypothesis  Test  for  1990  Survey  Respondents  Using 
CSC-TACS  Transmitter. 


MTB  >  ZTEST  11.123  17.753 
SUBO  ALTE=1. 

CIO; 

TEST  OF  MU  =  11.123  VS  MU 
THE  ASSUMED  SIGMA  =17.8 

G.T.  11.123 

N  MEAN 

STDEV  SE  MEAN 

Z 

P  VALUE 

LACERTET  9  19.333 

30.932  5.918 

1.39 

0.083 

Printout  17.  Rejection  Percentages,  Histogram  and  Hypothesis  Test 
for  1990  Survey  Respondents  Using  Lacerte  Transmitter. 
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MTB  >  ZTEST  11.123  17.753 
SUBO  ALTE-1. 

Cll; 

TEST  OF  MU  -  11.123  VS  MU 
THE  ASSUMED  SIGMA  -  17.8 

G.T.  11.123 

N  MEAN 

STDEV  SE  MEAN 

Z 

P  VALUE 

FLASHTXT  12  20.667 

15.390  5.125 

1.86 

0.031 

Printout  18.  Rejection  Percentages,  Hfetogram  and  Hypothesis  Test 
for  1990  Survey  Respondents  Using  Flashtax  Transmitter. 
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